[ 587.116774] env[69350]: INFO neutron.common.config [-] Logging enabled! [ 587.117114] env[69350]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev78 [ 587.117289] env[69350]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69350) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 587.117601] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 587.117704] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 587.118560] env[69350]: WARNING oslo_policy.policy [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 587.118776] env[69350]: WARNING oslo_policy.policy [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 587.120346] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] VMware NSXv3 Agent initialized successfully. [ 587.120715] env[69350]: DEBUG oslo_concurrency.lockutils [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Acquiring lock "singleton_lock" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.120856] env[69350]: DEBUG oslo_concurrency.lockutils [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Acquired lock "singleton_lock" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.121076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Releasing lock "singleton_lock" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.121460] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Full set of CONF: {{(pid=69350) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 587.121588] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ******************************************************************************** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 587.121702] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Configuration options gathered from: {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 587.121960] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 587.122154] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 587.122272] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ================================================================================ {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 587.122450] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] agent_down_time = 75 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.122599] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] allow_automatic_dhcp_failover = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.122744] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] allow_bulk = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.122896] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] api_extensions_path = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123105] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] api_paste_config = api-paste.ini {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123270] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] auth_strategy = keystone {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123388] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] backdoor_port = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123500] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] backdoor_socket = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123648] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] backlog = 4096 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123792] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.123956] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] bind_host = 0.0.0.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124120] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] bind_port = 9696 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124265] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] client_socket_timeout = 900 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124417] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] config_dir = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124536] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124681] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] config_source = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124827] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] control_exchange = neutron {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.124975] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] core_plugin = ml2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125162] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] debug = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125320] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] default_availability_zones = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125537] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125686] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dhcp_agent_notification = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125831] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dhcp_agents_per_network = 1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.125974] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dhcp_lease_duration = 86400 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126138] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dhcp_load_type = networks {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126285] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dns_domain = openstacklocal {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126431] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126572] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_default_route_bfd = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126711] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_default_route_ecmp = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126848] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_dvr = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.126984] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_new_agents = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127170] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127304] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_signals = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127444] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] enable_traditional_dhcp = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127582] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] external_dns_driver = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127758] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] filter_validation = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.127909] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] global_physnet_mtu = 8950 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128061] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] graceful_shutdown_timeout = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128259] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] host = cpu-1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128400] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] host_dvr_for_dhcp = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128540] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] http_retries = 3 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128686] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] instance_format = [instance: %(uuid)s] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128828] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.128968] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ipam_driver = internal {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129118] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ipv6_pd_enabled = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129279] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] l3_ha = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129482] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129639] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] l3_ha_network_physical_name = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129784] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] l3_ha_network_type = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.129929] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_color = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130084] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_config_append = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130231] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130372] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_dir = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130510] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_file = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130621] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_options = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130764] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_rotate_interval = 1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.130922] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_rotate_interval_type = days {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131126] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] log_rotation_type = none {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131251] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131368] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131520] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131688] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131802] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.131948] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_dns_nameservers = 5 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132105] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_header_line = 16384 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132247] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_l3_agents_per_router = 3 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132387] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_logfile_count = 30 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132526] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_logfile_size_mb = 200 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132665] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] max_subnet_host_routes = 20 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132807] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] my_ip = 10.180.1.21 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.132948] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] my_ipv6 = ::1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133098] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] network_auto_schedule = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133233] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] network_link_prefix = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133383] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133528] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] notify_nova_on_port_data_changes = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133676] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] notify_nova_on_port_status_changes = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133817] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] pagination_max_limit = -1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.133955] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] publish_errors = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134122] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rate_limit_burst = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134260] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rate_limit_except_level = CRITICAL {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134394] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rate_limit_interval = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134531] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] retry_until_window = 30 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134696] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] router_distributed = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134800] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rpc_resources_processing_step = 20 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.134938] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rpc_response_max_timeout = 600 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135110] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] rpc_response_timeout = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135265] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] send_events_interval = 2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135425] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] service_plugins = ['router'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135569] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] setproctitle = on {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135705] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] shell_completion = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135849] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] state_path = /opt/stack/data/neutron {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.135993] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] syslog_log_facility = LOG_USER {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136149] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] tcp_keepidle = 600 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136299] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] transport_url = **** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136439] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] use_journal = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136574] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] use_json = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136711] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] use_ssl = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136845] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] use_stderr = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.136988] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] use_syslog = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137169] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vlan_qinq = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137401] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vlan_transparent = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137474] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] watch_log_file = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137583] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] wsgi_default_pool_size = 100 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137720] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] wsgi_keep_alive = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137883] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.137998] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] wsgi_server_debug = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.138180] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_concurrency.disable_process_locking = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.138324] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.138475] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.138619] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.138768] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.138914] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139069] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139232] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.connection_string = messaging:// {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139383] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.enabled = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139554] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.es_doc_type = notification {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139706] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.es_scroll_size = 10000 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139854] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.es_scroll_time = 2m {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.139997] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.filter_error_trace = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140162] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.hmac_keys = **** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140313] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.sentinel_service_name = mymaster {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140466] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.socket_timeout = 0.1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140612] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.trace_requests = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140754] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler.trace_sqlalchemy = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.140914] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler_jaeger.process_tags = {} {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.141070] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler_jaeger.service_name_prefix = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.141215] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] profiler_otlp.service_name_prefix = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.141376] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.enforce_new_defaults = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.141664] env[69350]: WARNING oslo_config.cfg [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 587.141825] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.enforce_scope = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.141976] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.policy_default_rule = default {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142151] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142302] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142454] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142595] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142733] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.142871] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143019] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143169] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143325] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143480] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] agent.extensions = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143650] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143812] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] service_providers.service_provider = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.143963] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.default_quota = -1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144130] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144273] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_floatingip = 50 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144415] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_network = 100 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144552] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_port = 500 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144692] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144828] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_router = 10 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.144969] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_security_group = 10 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145151] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145305] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.quota_subnet = 100 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145450] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] QUOTAS.track_quota_usage = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145610] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145750] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.145891] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146049] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146199] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146344] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146498] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146637] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146776] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.146922] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147074] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147255] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_dhcp_release.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147403] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147548] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147690] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147837] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.147981] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148135] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_ovs_vsctl.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148287] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.capabilities = [21] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148426] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148570] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148715] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148858] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.148995] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_namespace.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149156] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.capabilities = [12] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149297] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149436] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149610] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149757] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.149894] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_conntrack.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150056] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.capabilities = [12, 21] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150199] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.group = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150340] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.helper_command = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150512] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150618] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.thread_pool_size = 8 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150755] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] privsep_link.user = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.150914] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151083] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151232] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.continue_on_failed_promotions = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151375] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.dscp = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151518] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.dscp_inherit = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151669] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.force_mp_to_policy = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151808] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.locking_coordinator_url = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.151949] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.log_agent_heartbeats = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152101] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.logging_expire = 1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152250] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152395] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152545] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.polling_interval = 240 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152694] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152840] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.152987] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.report_interval = 30.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153152] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153303] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153466] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153588] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.sync_skew = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153731] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.synchronization_queue_size = 20 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.153876] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT.use_helper_for_ns_read = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154034] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] SECURITYGROUP.enable_ipset = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154190] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] SECURITYGROUP.enable_security_group = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154336] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154505] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154623] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] experimental.ipv6_pd_enabled = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154785] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.extension_drivers = ['port_security'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.154929] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.external_network_type = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155117] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155287] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.overlay_ip_version = 4 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155441] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.path_mtu = 8950 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155597] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.physical_network_mtus = {} {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155778] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.155933] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156101] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ml2.type_drivers = ['vlan'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156256] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156401] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156543] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156697] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156850] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.156999] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.157191] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.157346] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.157495] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.157711] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.157871] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_login_password = **** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158037] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158192] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_login_user = admin {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158375] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158533] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158706] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.158853] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159028] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159189] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159341] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159518] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159691] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.159850] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160038] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160201] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160356] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160566] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160723] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.160874] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161031] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161194] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.auth_section = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161355] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.auth_type = password {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161504] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161646] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.certfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161791] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.collect_timing = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.161942] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.endpoint_type = public {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162098] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.insecure = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162241] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.keyfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162395] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.region_name = RegionOne {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162539] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.split_loggers = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162681] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] nova.timeout = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162830] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.auth_section = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.162982] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.auth_type = password {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163144] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163288] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.certfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163432] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.collect_timing = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163580] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.endpoint_type = public {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163721] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.insecure = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163860] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.keyfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.163996] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.region_name = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164152] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.split_loggers = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164290] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] placement.timeout = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164436] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.auth_section = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164579] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.auth_type = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164717] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.cafile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164855] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.certfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.164997] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.collect_timing = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165175] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.connect_retries = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165322] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.connect_retry_delay = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165467] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.enable_notifications = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165606] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.endpoint_override = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165750] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.insecure = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.165891] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.interface = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166040] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.keyfile = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166181] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.max_version = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166321] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.min_version = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166458] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.region_name = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166594] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.retriable_status_codes = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166746] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.service_name = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.166888] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.service_type = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.167062] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.split_loggers = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.167264] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.status_code_retries = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.167416] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.status_code_retry_delay = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168235] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.timeout = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168235] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.valid_interfaces = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168235] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ironic.version = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168235] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] cli_script.dry_run = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168235] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168406] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168561] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168673] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168816] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.168960] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169115] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169262] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169408] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169561] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169703] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169885] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.169995] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170161] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170308] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170455] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170599] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170739] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.170886] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171039] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171525] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171525] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171525] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171649] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171749] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.171893] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172046] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172237] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172372] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172470] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172610] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172758] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.172902] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173119] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173286] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173436] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173579] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173751] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_notifications.driver = [] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.173875] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_notifications.retry = -1 {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.174044] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.174190] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.174308] env[69350]: DEBUG oslo_service.backend.eventlet.service [None req-8d2c1a4b-dc9e-45e3-9eaf-507328f7a297 None None] ******************************************************************************** {{(pid=69350) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 587.175475] env[69350]: DEBUG neutron.agent.securitygroups_rpc [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Init firewall settings (driver=nsxv3) {{(pid=69350) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 587.176807] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69350) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 587.177103] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] RPC agent_id: nsxm-l-01a.corp.local [ 587.179557] env[69350]: DEBUG dogpile.cache.region [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.179685] env[69350]: DEBUG dogpile.lock [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.179788] env[69350]: DEBUG dogpile.lock [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.179884] env[69350]: DEBUG dogpile.lock [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.179985] env[69350]: DEBUG dogpile.cache.region [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.180089] env[69350]: DEBUG dogpile.lock [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.180219] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.201208] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Session token - acquiring [ 587.202726] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.202932] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.203024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.203482] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.213801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.494722] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 587.531054] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.531281] env[69350]: DEBUG dogpile.cache.region [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Cache value generated in 0.351 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 587.531439] env[69350]: DEBUG dogpile.lock [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.531574] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Activating Policy API Provider. [ 587.531777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Looking for the default Infrastructure Rules. [ 587.612280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Looking for the Default Layer3 Logged Drop Section. [ 587.631354] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 587.631890] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.632110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.632272] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.632667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.633071] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.152195] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.654822] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.157885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Inventory metadata is going to be refreshed. [ 589.158284] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 590.005608] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.005885] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.005930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.006298] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.017010] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 590.017921] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.018883] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 590.037234] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.037500] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.037569] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.037849] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.037976] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.038139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 590.038262] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.038371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 590.058263] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.058501] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.058545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.058845] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.059030] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.059185] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 590.078792] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.079044] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.079093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.079399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.079570] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.079730] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 590.101577] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.101787] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.101830] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.102167] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.102373] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.102549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 590.102658] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.102767] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 590.122030] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.122272] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.122317] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.122650] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.122781] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.122932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 590.123056] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.123170] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 590.142517] env[69350]: DEBUG networking_nsxv3.common.locking [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.142754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.142971] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.143182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.143334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.143492] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 590.143598] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.143702] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Inventory metadata have been refreshed. [ 590.143804] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Dryrun:True. Metadata refresh completed. [ 590.143924] env[69350]: DEBUG oslo_concurrency.lockutils [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.145616] env[69350]: INFO neutron.agent.agent_extensions_manager [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Loaded agent extensions: [] [ 590.146393] env[69350]: DEBUG neutron_lib.callbacks.manager [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69350) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 590.212016] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent RPC Daemon Started! [ 590.212361] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:0 started [ 590.212361] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent out of sync with plugin! [ 595.147025] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.147398] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 596.149024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.149348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.149348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.149657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.149847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.652710] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.154728] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.656539] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 597.656704] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 598.382876] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.383311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.383311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.383311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.394438] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 598.395434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.396405] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 598.417807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.417992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.417992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.418181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.418264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.418375] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 598.418442] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 598.418517] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 598.437791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.438196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.438196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.438355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.438355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.438536] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 598.459870] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.460318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.460426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.460541] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 598.481224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.481482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.481560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.481764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.481872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.482015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 598.482093] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 598.482166] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 598.501333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.501557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.501557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.501759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.501843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.501952] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 598.502042] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 598.502122] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 598.520911] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.521180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.521180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.521350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.521457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.521584] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 598.521661] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 598.521730] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 598.521797] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 598.521871] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 598.521935] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 598.522016] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 598.522270] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 598.522338] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 598.522405] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 598.542173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.542400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.542400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.542593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.542698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.542810] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 598.564222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.564432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.564469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.564666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.564773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.577621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.147974] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.148350] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 604.907770] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0c6fbc29-5f8f-462b-a8e0-a928cba18922 demo admin] Enqueued Resource ID: 0aa42a06-e853-40ef-afca-04bf9e55481c with Priority: HIGHEST for action security_group_rules [ 604.908388] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aa42a06-e853-40ef-afca-04bf9e55481c with Priority: HIGHEST for action security_group_rules [ 604.908789] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aa42a06-e853-40ef-afca-04bf9e55481c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.908935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aa42a06-e853-40ef-afca-04bf9e55481c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.908999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aa42a06-e853-40ef-afca-04bf9e55481c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.909277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aa42a06-e853-40ef-afca-04bf9e55481c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.909376] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aa42a06-e853-40ef-afca-04bf9e55481c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.429578] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.429886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.429886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.430104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.430104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.430223] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aa42a06-e853-40ef-afca-04bf9e55481c already deleted. [ 605.430273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aa42a06-e853-40ef-afca-04bf9e55481c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.910024] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 609.910406] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 614.911489] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 614.911769] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 619.912994] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 619.913396] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 624.913900] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 624.914295] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 629.914932] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 629.914932] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 634.916401] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 634.916732] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 634.969772] env[69350]: INFO networking_nsxv3.common.synchronization [None req-06adfe3d-55e5-40e5-92c4-2174d32c8509 None None] Enqueued Resource ID: 8bb5d40e-dc87-4e96-8037-4b73b864c7ee with Priority: HIGHEST for action port [ 634.970020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb5d40e-dc87-4e96-8037-4b73b864c7ee with Priority: HIGHEST for action port [ 634.970629] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb5d40e-dc87-4e96-8037-4b73b864c7ee taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.970690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb5d40e-dc87-4e96-8037-4b73b864c7ee" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.970875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb5d40e-dc87-4e96-8037-4b73b864c7ee" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.970996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb5d40e-dc87-4e96-8037-4b73b864c7ee" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.971200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb5d40e-dc87-4e96-8037-4b73b864c7ee',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.475253] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bb5d40e-dc87-4e96-8037-4b73b864c7ee [ 635.476326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.476326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.476326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.476326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.476326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.476326] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bb5d40e-dc87-4e96-8037-4b73b864c7ee already deleted. [ 635.476326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb5d40e-dc87-4e96-8037-4b73b864c7ee" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.487205] env[69350]: INFO networking_nsxv3.common.synchronization [None req-44d6aff9-9e2f-452a-9be7-da318a87b776 None None] Enqueued Resource ID: d27c33ce-3060-4172-8189-7bc1a29163fc with Priority: HIGHEST for action port [ 636.487205] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d27c33ce-3060-4172-8189-7bc1a29163fc with Priority: HIGHEST for action port [ 636.489593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d27c33ce-3060-4172-8189-7bc1a29163fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.489593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d27c33ce-3060-4172-8189-7bc1a29163fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.489593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d27c33ce-3060-4172-8189-7bc1a29163fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.489593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d27c33ce-3060-4172-8189-7bc1a29163fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.489956] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d27c33ce-3060-4172-8189-7bc1a29163fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.648932] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c23a372d-a7bc-4da0-8473-d7c37d28a968 None None] Enqueued Resource ID: 1ee22874-eeb7-4bf4-baac-2c2f854cd7de with Priority: HIGHEST for action port [ 636.649598] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ee22874-eeb7-4bf4-baac-2c2f854cd7de with Priority: HIGHEST for action port [ 636.650471] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ee22874-eeb7-4bf4-baac-2c2f854cd7de taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.650647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ee22874-eeb7-4bf4-baac-2c2f854cd7de" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.650743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ee22874-eeb7-4bf4-baac-2c2f854cd7de" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.651158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ee22874-eeb7-4bf4-baac-2c2f854cd7de" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.651433] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee22874-eeb7-4bf4-baac-2c2f854cd7de',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.993263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d27c33ce-3060-4172-8189-7bc1a29163fc [ 636.993263] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.993263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.993263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.993777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.993777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.993777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d27c33ce-3060-4172-8189-7bc1a29163fc already deleted. [ 636.993777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d27c33ce-3060-4172-8189-7bc1a29163fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.154655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ee22874-eeb7-4bf4-baac-2c2f854cd7de [ 637.154884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.155032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.155105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.155310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.155396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.155486] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ee22874-eeb7-4bf4-baac-2c2f854cd7de already deleted. [ 637.155565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ee22874-eeb7-4bf4-baac-2c2f854cd7de" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.581300] env[69350]: INFO networking_nsxv3.common.synchronization [None req-266bd1e0-2f33-4a69-bd8d-931fecc69d05 None None] Enqueued Resource ID: c952a63e-5879-445b-8c8a-476e638b83ec with Priority: HIGHEST for action port [ 637.581584] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c952a63e-5879-445b-8c8a-476e638b83ec with Priority: HIGHEST for action port [ 637.582133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c952a63e-5879-445b-8c8a-476e638b83ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.582372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c952a63e-5879-445b-8c8a-476e638b83ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.582372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c952a63e-5879-445b-8c8a-476e638b83ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.583472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c952a63e-5879-445b-8c8a-476e638b83ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.583472] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c952a63e-5879-445b-8c8a-476e638b83ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.084904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c952a63e-5879-445b-8c8a-476e638b83ec [ 638.085172] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.085312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.085407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.085603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.085701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.087208] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c952a63e-5879-445b-8c8a-476e638b83ec already deleted. [ 638.087208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c952a63e-5879-445b-8c8a-476e638b83ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.524423] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b12adea6-b063-4128-887e-3ddd33526109 None None] Enqueued Resource ID: a7621265-e7b4-403a-94ec-bac705909844 with Priority: HIGHEST for action port [ 639.524423] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7621265-e7b4-403a-94ec-bac705909844 with Priority: HIGHEST for action port [ 639.525059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7621265-e7b4-403a-94ec-bac705909844 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.525309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7621265-e7b4-403a-94ec-bac705909844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.525309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7621265-e7b4-403a-94ec-bac705909844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.525719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7621265-e7b4-403a-94ec-bac705909844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.525719] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7621265-e7b4-403a-94ec-bac705909844',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.720682] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4bb08e55-00c8-48f9-902e-6d591cf46b63 None None] Enqueued Resource ID: 53effb75-dfa3-49ce-967a-35cfb0e4009c with Priority: HIGHEST for action port [ 639.720936] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53effb75-dfa3-49ce-967a-35cfb0e4009c with Priority: HIGHEST for action port [ 639.721620] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-53effb75-dfa3-49ce-967a-35cfb0e4009c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.721875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53effb75-dfa3-49ce-967a-35cfb0e4009c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.721875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53effb75-dfa3-49ce-967a-35cfb0e4009c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.722427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53effb75-dfa3-49ce-967a-35cfb0e4009c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.722511] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53effb75-dfa3-49ce-967a-35cfb0e4009c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.939553] env[69350]: INFO networking_nsxv3.common.synchronization [None req-63019cfd-b261-4651-bb23-0508ca2c3097 None None] Enqueued Resource ID: a9a6d8da-489b-418e-ad22-76df937b8ca5 with Priority: HIGHEST for action port [ 639.939931] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a6d8da-489b-418e-ad22-76df937b8ca5 with Priority: HIGHEST for action port [ 639.940378] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9a6d8da-489b-418e-ad22-76df937b8ca5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.940511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9a6d8da-489b-418e-ad22-76df937b8ca5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.941342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9a6d8da-489b-418e-ad22-76df937b8ca5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.941342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9a6d8da-489b-418e-ad22-76df937b8ca5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.941342] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9a6d8da-489b-418e-ad22-76df937b8ca5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.018451] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9bae0110-254c-43a0-9475-c73dfb24350f None None] Enqueued Resource ID: dc9412dc-2d26-4970-a30f-d9ca6ab7daa9 with Priority: HIGHEST for action port [ 640.019019] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9412dc-2d26-4970-a30f-d9ca6ab7daa9 with Priority: HIGHEST for action port [ 640.019325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc9412dc-2d26-4970-a30f-d9ca6ab7daa9 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.019453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc9412dc-2d26-4970-a30f-d9ca6ab7daa9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.019528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc9412dc-2d26-4970-a30f-d9ca6ab7daa9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.019800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc9412dc-2d26-4970-a30f-d9ca6ab7daa9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.019869] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc9412dc-2d26-4970-a30f-d9ca6ab7daa9',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.029137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7621265-e7b4-403a-94ec-bac705909844 [ 640.029137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.029137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.029137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.029137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.029137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.029137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7621265-e7b4-403a-94ec-bac705909844 already deleted. [ 640.029137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7621265-e7b4-403a-94ec-bac705909844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.228457] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53effb75-dfa3-49ce-967a-35cfb0e4009c [ 640.232097] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.232097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.232097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.232097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.232097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.232097] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53effb75-dfa3-49ce-967a-35cfb0e4009c already deleted. [ 640.232097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53effb75-dfa3-49ce-967a-35cfb0e4009c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.327389] env[69350]: INFO networking_nsxv3.common.synchronization [None req-bda949d5-a025-4f07-9c7a-fe7a809a1d5f None None] Enqueued Resource ID: b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627 with Priority: HIGHEST for action port [ 640.327389] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627 with Priority: HIGHEST for action port [ 640.327389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.327389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.327389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.327389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.327389] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.443733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9a6d8da-489b-418e-ad22-76df937b8ca5 [ 640.443973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.444143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.444241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.444415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.444507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.444654] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9a6d8da-489b-418e-ad22-76df937b8ca5 already deleted. [ 640.444708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9a6d8da-489b-418e-ad22-76df937b8ca5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.487945] env[69350]: INFO networking_nsxv3.common.synchronization [None req-5c4549f2-59de-4139-a810-828322349cc4 None None] Enqueued Resource ID: 02f6e95d-2a55-4803-bf05-77f858db2f26 with Priority: HIGHEST for action port [ 640.488491] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02f6e95d-2a55-4803-bf05-77f858db2f26 with Priority: HIGHEST for action port [ 640.488832] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-02f6e95d-2a55-4803-bf05-77f858db2f26 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.489011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02f6e95d-2a55-4803-bf05-77f858db2f26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.489011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02f6e95d-2a55-4803-bf05-77f858db2f26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.489449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02f6e95d-2a55-4803-bf05-77f858db2f26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.489688] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f6e95d-2a55-4803-bf05-77f858db2f26',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.523479] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc9412dc-2d26-4970-a30f-d9ca6ab7daa9 [ 640.523479] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.523479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.523479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.523727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.523727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.523841] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc9412dc-2d26-4970-a30f-d9ca6ab7daa9 already deleted. [ 640.523890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc9412dc-2d26-4970-a30f-d9ca6ab7daa9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.830652] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627 [ 640.830881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.831011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.831220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.831294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.831380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.831476] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627 already deleted. [ 640.831559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ef4ffb-8f65-4130-9ad8-fb9ee29d0627" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.992854] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02f6e95d-2a55-4803-bf05-77f858db2f26 [ 640.992854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.992854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.992854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.992854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.992854] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02f6e95d-2a55-4803-bf05-77f858db2f26 already deleted. [ 640.992854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02f6e95d-2a55-4803-bf05-77f858db2f26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.250755] env[69350]: INFO networking_nsxv3.common.synchronization [None req-342b3a48-9dc4-4f30-9ca1-2aef346add50 None None] Enqueued Resource ID: d624f582-d536-4402-90b1-2fc353ba5f40 with Priority: HIGHEST for action port [ 643.250992] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d624f582-d536-4402-90b1-2fc353ba5f40 with Priority: HIGHEST for action port [ 643.251580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d624f582-d536-4402-90b1-2fc353ba5f40 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.251777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d624f582-d536-4402-90b1-2fc353ba5f40" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.251849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d624f582-d536-4402-90b1-2fc353ba5f40" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.256924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d624f582-d536-4402-90b1-2fc353ba5f40" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.256924] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d624f582-d536-4402-90b1-2fc353ba5f40',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.757310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d624f582-d536-4402-90b1-2fc353ba5f40 [ 643.757758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.757868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.757968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.758285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.758417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.758569] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d624f582-d536-4402-90b1-2fc353ba5f40 already deleted. [ 643.758686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d624f582-d536-4402-90b1-2fc353ba5f40" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.984692] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0b3b7379-22e5-4372-9be8-b44498ae7d27 None None] Enqueued Resource ID: 6261f7c3-c538-441e-b585-7ad6c1a039c8 with Priority: HIGHEST for action port [ 644.984983] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6261f7c3-c538-441e-b585-7ad6c1a039c8 with Priority: HIGHEST for action port [ 644.985501] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6261f7c3-c538-441e-b585-7ad6c1a039c8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.985622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6261f7c3-c538-441e-b585-7ad6c1a039c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.985704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6261f7c3-c538-441e-b585-7ad6c1a039c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.985985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6261f7c3-c538-441e-b585-7ad6c1a039c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.986147] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6261f7c3-c538-441e-b585-7ad6c1a039c8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.489247] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6261f7c3-c538-441e-b585-7ad6c1a039c8 [ 645.489247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.489247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.489247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.489507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.489507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.489507] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6261f7c3-c538-441e-b585-7ad6c1a039c8 already deleted. [ 645.489586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6261f7c3-c538-441e-b585-7ad6c1a039c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.027402] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3973fee8-a88a-4093-8610-f19adbaf2da4 None None] Enqueued Resource ID: 02ad7b24-9f7f-4ea8-b366-fb079532d49d with Priority: HIGHEST for action port [ 646.027402] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ad7b24-9f7f-4ea8-b366-fb079532d49d with Priority: HIGHEST for action port [ 646.027621] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-02ad7b24-9f7f-4ea8-b366-fb079532d49d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.027621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02ad7b24-9f7f-4ea8-b366-fb079532d49d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.027710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02ad7b24-9f7f-4ea8-b366-fb079532d49d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.028335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02ad7b24-9f7f-4ea8-b366-fb079532d49d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.028335] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02ad7b24-9f7f-4ea8-b366-fb079532d49d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.119565] env[69350]: INFO networking_nsxv3.common.synchronization [None req-767127c5-6571-4667-ae2b-3f2a78db52fc None None] Enqueued Resource ID: 1f775420-a0bd-4c25-9393-72b7daaa93bc with Priority: HIGHEST for action port [ 646.119565] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f775420-a0bd-4c25-9393-72b7daaa93bc with Priority: HIGHEST for action port [ 646.119565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f775420-a0bd-4c25-9393-72b7daaa93bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.119565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f775420-a0bd-4c25-9393-72b7daaa93bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.119565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f775420-a0bd-4c25-9393-72b7daaa93bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.121904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f775420-a0bd-4c25-9393-72b7daaa93bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.121904] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f775420-a0bd-4c25-9393-72b7daaa93bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.485572] env[69350]: INFO networking_nsxv3.common.synchronization [None req-365b2be3-e055-4a10-80da-e81a4edf866d None None] Enqueued Resource ID: bf5fd1bc-aa03-406f-be50-fde31d90938a with Priority: HIGHEST for action port [ 646.485677] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5fd1bc-aa03-406f-be50-fde31d90938a with Priority: HIGHEST for action port [ 646.486257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5fd1bc-aa03-406f-be50-fde31d90938a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.486387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5fd1bc-aa03-406f-be50-fde31d90938a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.486461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5fd1bc-aa03-406f-be50-fde31d90938a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.486713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5fd1bc-aa03-406f-be50-fde31d90938a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.486799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5fd1bc-aa03-406f-be50-fde31d90938a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.533542] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02ad7b24-9f7f-4ea8-b366-fb079532d49d [ 646.534661] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.534661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.534661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.534661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.534661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.534661] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02ad7b24-9f7f-4ea8-b366-fb079532d49d already deleted. [ 646.534661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02ad7b24-9f7f-4ea8-b366-fb079532d49d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.598488] env[69350]: INFO networking_nsxv3.common.synchronization [None req-12ebbb17-3888-4e2f-ba5d-0f5f320b4488 None None] Enqueued Resource ID: 8dd89811-1448-4d22-9870-920c717a1019 with Priority: HIGHEST for action port [ 646.598488] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd89811-1448-4d22-9870-920c717a1019 with Priority: HIGHEST for action port [ 646.599270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd89811-1448-4d22-9870-920c717a1019 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.599587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd89811-1448-4d22-9870-920c717a1019" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.599788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd89811-1448-4d22-9870-920c717a1019" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.600119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd89811-1448-4d22-9870-920c717a1019" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.600291] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd89811-1448-4d22-9870-920c717a1019',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.625279] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f775420-a0bd-4c25-9393-72b7daaa93bc [ 646.625279] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.625279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.625279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.625279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.625279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.625279] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f775420-a0bd-4c25-9393-72b7daaa93bc already deleted. [ 646.625279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f775420-a0bd-4c25-9393-72b7daaa93bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.881516] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a0df7305-91c4-4877-ba6d-d724afff3017 None None] Enqueued Resource ID: 8ddc9ee5-6737-47db-9b40-ee38d7e8f07d with Priority: HIGHEST for action port [ 646.881516] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ddc9ee5-6737-47db-9b40-ee38d7e8f07d with Priority: HIGHEST for action port [ 646.881516] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ddc9ee5-6737-47db-9b40-ee38d7e8f07d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.881516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ddc9ee5-6737-47db-9b40-ee38d7e8f07d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.881516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ddc9ee5-6737-47db-9b40-ee38d7e8f07d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.881516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ddc9ee5-6737-47db-9b40-ee38d7e8f07d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.881516] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ddc9ee5-6737-47db-9b40-ee38d7e8f07d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.989592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf5fd1bc-aa03-406f-be50-fde31d90938a [ 646.990808] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.991776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.995545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.995545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.995545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.995545] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf5fd1bc-aa03-406f-be50-fde31d90938a already deleted. [ 646.995545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5fd1bc-aa03-406f-be50-fde31d90938a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.102819] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dd89811-1448-4d22-9870-920c717a1019 [ 647.103108] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.103949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.103949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.103949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.103949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.103949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dd89811-1448-4d22-9870-920c717a1019 already deleted. [ 647.103949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd89811-1448-4d22-9870-920c717a1019" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.385533] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ddc9ee5-6737-47db-9b40-ee38d7e8f07d [ 647.385533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.385533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.385533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.386835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.386835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.386835] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ddc9ee5-6737-47db-9b40-ee38d7e8f07d already deleted. [ 647.386835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ddc9ee5-6737-47db-9b40-ee38d7e8f07d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.500548] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c5c1db9d-25b9-442e-8eda-0feae17a531b None None] Enqueued Resource ID: de1382df-aa17-45f0-bfe3-95cfafdeeec5 with Priority: HIGHEST for action port [ 647.502064] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de1382df-aa17-45f0-bfe3-95cfafdeeec5 with Priority: HIGHEST for action port [ 647.502681] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-de1382df-aa17-45f0-bfe3-95cfafdeeec5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.502681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de1382df-aa17-45f0-bfe3-95cfafdeeec5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.502681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de1382df-aa17-45f0-bfe3-95cfafdeeec5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.503121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de1382df-aa17-45f0-bfe3-95cfafdeeec5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.503121] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de1382df-aa17-45f0-bfe3-95cfafdeeec5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.007443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de1382df-aa17-45f0-bfe3-95cfafdeeec5 [ 648.007677] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.007816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.007902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.008178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.008268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.008362] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de1382df-aa17-45f0-bfe3-95cfafdeeec5 already deleted. [ 648.008456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de1382df-aa17-45f0-bfe3-95cfafdeeec5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.171312] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c448f007-5c89-440e-816e-d99ebce746b3 None None] Enqueued Resource ID: 7bd2cb14-89cd-494c-b042-76cc40ac6daf with Priority: HIGHEST for action port [ 648.171312] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd2cb14-89cd-494c-b042-76cc40ac6daf with Priority: HIGHEST for action port [ 648.171312] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd2cb14-89cd-494c-b042-76cc40ac6daf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.171312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd2cb14-89cd-494c-b042-76cc40ac6daf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.171312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd2cb14-89cd-494c-b042-76cc40ac6daf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.172038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd2cb14-89cd-494c-b042-76cc40ac6daf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.172246] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd2cb14-89cd-494c-b042-76cc40ac6daf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.375523] env[69350]: INFO networking_nsxv3.common.synchronization [None req-90c579d0-7f9d-427c-a4c5-98f3b4d3244d None None] Enqueued Resource ID: 2446416a-a59b-4c66-ad07-f7bec9678e90 with Priority: HIGHEST for action port [ 648.376090] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2446416a-a59b-4c66-ad07-f7bec9678e90 with Priority: HIGHEST for action port [ 648.376439] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2446416a-a59b-4c66-ad07-f7bec9678e90 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.376567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2446416a-a59b-4c66-ad07-f7bec9678e90" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.376634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2446416a-a59b-4c66-ad07-f7bec9678e90" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.382802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2446416a-a59b-4c66-ad07-f7bec9678e90" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.382802] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2446416a-a59b-4c66-ad07-f7bec9678e90',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.675482] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bd2cb14-89cd-494c-b042-76cc40ac6daf [ 648.675706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.675921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.675921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.676179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.676276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.676371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bd2cb14-89cd-494c-b042-76cc40ac6daf already deleted. [ 648.676453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd2cb14-89cd-494c-b042-76cc40ac6daf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.886076] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2446416a-a59b-4c66-ad07-f7bec9678e90 [ 648.886332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.886486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.886541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.886799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.886881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.886975] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2446416a-a59b-4c66-ad07-f7bec9678e90 already deleted. [ 648.888426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2446416a-a59b-4c66-ad07-f7bec9678e90" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.938024] env[69350]: INFO networking_nsxv3.common.synchronization [req-99136fe6-a83a-4019-88f4-de80eab99c5c req-e88e0c3d-c935-4987-bd9b-971c4c27fae6 tempest-DeleteServersAdminTestJSON-1592801387 tempest-DeleteServersAdminTestJSON-1592801387-project-member] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 649.938566] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 649.938977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.939301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.939401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.939647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.940227] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.940227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.940227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.940227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.940227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.940430] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.135277] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3e247b95-141b-4a04-84c6-dd94041ae5ab None None] Enqueued Resource ID: 1f898070-59a4-40a0-9e5c-84faa0be433e with Priority: HIGHEST for action port [ 650.135554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f898070-59a4-40a0-9e5c-84faa0be433e with Priority: HIGHEST for action port [ 650.139093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f898070-59a4-40a0-9e5c-84faa0be433e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.139264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f898070-59a4-40a0-9e5c-84faa0be433e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.139337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f898070-59a4-40a0-9e5c-84faa0be433e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.139601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f898070-59a4-40a0-9e5c-84faa0be433e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.139688] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f898070-59a4-40a0-9e5c-84faa0be433e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.146398] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c30a34eb-bb92-4fe9-855d-580a54f6e481 tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 650.147320] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 650.147653] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.147860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.147918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.150061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.150061] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.442261] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.442477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.442552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.443170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.446648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.447092] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.447367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.447508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.448902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.448902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.448902] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 already deleted. [ 650.448902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.511996] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b1703016-ed1f-4109-a954-e6015d1c2fe2 tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 650.512561] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 650.512865] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.513017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.642655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f898070-59a4-40a0-9e5c-84faa0be433e [ 650.643098] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.643275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.643356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.643576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.644157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.644157] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f898070-59a4-40a0-9e5c-84faa0be433e already deleted. [ 650.644157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f898070-59a4-40a0-9e5c-84faa0be433e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.670938] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.671225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.671225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.671654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.671654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.671654] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 already deleted. [ 650.671744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.672080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.672080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.672295] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.201228] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.201521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.201521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.201749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.201938] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 already deleted. [ 651.202010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.647940] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-d3835ccc-1753-45db-9f97-a91d5904f462 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 651.647940] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 651.648560] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.648956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.651019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.651019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.651019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.879518] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.879798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.881214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.881214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.881214] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.881214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.881662] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.882600] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.882943] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.883504] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.883765] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.884050] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.884293] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.884748] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.886712] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.886712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.907062] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.907062] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.907062] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.907062] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.908090] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-aa5808df-d1d2-4d48-af13-59af452e2dfd taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.908348] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.908511] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.908895] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.909200] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5808df-d1d2-4d48-af13-59af452e2dfd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.156539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.156539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.156539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.156539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.156539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.156539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.156888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.156888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.156888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.156888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.156999] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 already deleted. [ 652.157052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.413908] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.414168] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.414260] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.414549] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.414688] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.414840] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port aa5808df-d1d2-4d48-af13-59af452e2dfd not found, creating... [ 652.415102] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.415266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.415387] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.415606] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.415750] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.416177] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.416344] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.416469] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.416680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.416816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.416956] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: aa5808df-d1d2-4d48-af13-59af452e2dfd is going to be created. [ 652.439543] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.439754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.439883] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.440188] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.440578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.440659] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.656284] env[69350]: INFO networking_nsxv3.common.synchronization [None req-07bf59f7-2438-453e-8674-8c6081501537 None None] Enqueued Resource ID: 0260b60b-739e-4cf7-ae6f-e9606f98b224 with Priority: HIGHEST for action port [ 652.656826] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0260b60b-739e-4cf7-ae6f-e9606f98b224 with Priority: HIGHEST for action port [ 652.657635] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-0260b60b-739e-4cf7-ae6f-e9606f98b224 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.657787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0260b60b-739e-4cf7-ae6f-e9606f98b224" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.657828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0260b60b-739e-4cf7-ae6f-e9606f98b224" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.658895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0260b60b-739e-4cf7-ae6f-e9606f98b224" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.658995] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0260b60b-739e-4cf7-ae6f-e9606f98b224',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.727474] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.727474] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.727474] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.727962] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.731798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.731798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.731798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.731798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.731798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.731798] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.731798] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.731798] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.731798] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.731798] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.731798] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.731798] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.753100] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.753278] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.753430] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.753589] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.753902] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-f47429a3-e05f-4e13-9450-6cfb300b5160 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.754111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.754819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.754819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.754819] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47429a3-e05f-4e13-9450-6cfb300b5160',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.163240] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0260b60b-739e-4cf7-ae6f-e9606f98b224 [ 653.163240] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.164592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.164592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.164592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.164592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.164592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0260b60b-739e-4cf7-ae6f-e9606f98b224 already deleted. [ 653.164592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0260b60b-739e-4cf7-ae6f-e9606f98b224" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.260682] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.260911] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.261078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.261389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.261572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.261649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port f47429a3-e05f-4e13-9450-6cfb300b5160 not found, creating... [ 653.261985] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.262128] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.262259] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.262486] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.262623] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.263068] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.263690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.263862] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.264128] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.264277] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.266108] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: f47429a3-e05f-4e13-9450-6cfb300b5160 is going to be created. [ 653.286434] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.286658] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.286781] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.287491] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.288048] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.288414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.371982] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4ee66051-36bc-4ee5-8081-30b3ddfac8c8 None None] Enqueued Resource ID: 6959834b-d2e3-4e75-bb0d-f981d845e70a with Priority: HIGHEST for action port [ 653.372168] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6959834b-d2e3-4e75-bb0d-f981d845e70a with Priority: HIGHEST for action port [ 653.372761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6959834b-d2e3-4e75-bb0d-f981d845e70a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.372878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6959834b-d2e3-4e75-bb0d-f981d845e70a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.373646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6959834b-d2e3-4e75-bb0d-f981d845e70a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.373646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6959834b-d2e3-4e75-bb0d-f981d845e70a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.373646] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6959834b-d2e3-4e75-bb0d-f981d845e70a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.879237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6959834b-d2e3-4e75-bb0d-f981d845e70a [ 653.879532] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.879602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.879675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.880248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.880248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.880248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6959834b-d2e3-4e75-bb0d-f981d845e70a already deleted. [ 653.880248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6959834b-d2e3-4e75-bb0d-f981d845e70a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.257136] env[69350]: INFO networking_nsxv3.common.synchronization [req-99136fe6-a83a-4019-88f4-de80eab99c5c req-b63925b9-3dac-4ae5-b5de-bb74816529fd service nova] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_rules [ 654.257319] env[69350]: INFO networking_nsxv3.common.synchronization [req-99136fe6-a83a-4019-88f4-de80eab99c5c req-b63925b9-3dac-4ae5-b5de-bb74816529fd service nova] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 654.257456] env[69350]: INFO networking_nsxv3.common.synchronization [req-99136fe6-a83a-4019-88f4-de80eab99c5c req-b63925b9-3dac-4ae5-b5de-bb74816529fd service nova] Enqueued Resource ID: aa5808df-d1d2-4d48-af13-59af452e2dfd with Priority: HIGHEST for action port [ 654.257823] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_rules [ 654.257823] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 654.258042] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5808df-d1d2-4d48-af13-59af452e2dfd with Priority: HIGHEST for action port [ 654.260703] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.260703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.260703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.260703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.261084] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.261717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.261834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.261898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.262095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.262242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.262336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.262390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.262537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.262620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.262710] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.263771] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5808df-d1d2-4d48-af13-59af452e2dfd taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.264175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.264253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.264424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.264484] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5808df-d1d2-4d48-af13-59af452e2dfd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.532607] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-575bae93-3b2d-4ed8-87f9-b3c65d8c226b tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 654.532607] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 654.533837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.534035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.534179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.534434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.534895] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.535135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.535331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.535501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.535685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.535849] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.766761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.766940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.777592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa5808df-d1d2-4d48-af13-59af452e2dfd with status ACTIVE [ 654.779735] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.779735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.779735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.779735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.779999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.780353] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.780517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.780609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.780863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.780976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.781204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.781327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.781399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.781606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.781697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.781801] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa5808df-d1d2-4d48-af13-59af452e2dfd is going to be updated. [ 654.785263] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.809327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.809327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.809327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.809327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.809327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.809327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5808df-d1d2-4d48-af13-59af452e2dfd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.822931] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6cb7eb1c-b761-4745-b449-7e9e56d729f4 None None] Enqueued Resource ID: 1a45898c-36fc-4fcd-a0cf-5c78d804a157 with Priority: HIGHEST for action port [ 654.822931] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a45898c-36fc-4fcd-a0cf-5c78d804a157 with Priority: HIGHEST for action port [ 654.822931] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a45898c-36fc-4fcd-a0cf-5c78d804a157 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.822931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a45898c-36fc-4fcd-a0cf-5c78d804a157" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.822931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a45898c-36fc-4fcd-a0cf-5c78d804a157" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.823483] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a45898c-36fc-4fcd-a0cf-5c78d804a157" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.827026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a45898c-36fc-4fcd-a0cf-5c78d804a157',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.040858] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.045842] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-4ed285ed-deb6-4b84-8a89-074d70a61e42 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 655.045977] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-4ed285ed-deb6-4b84-8a89-074d70a61e42 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 655.046140] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-4ed285ed-deb6-4b84-8a89-074d70a61e42 service nova] Enqueued Resource ID: f47429a3-e05f-4e13-9450-6cfb300b5160 with Priority: HIGHEST for action port [ 655.046503] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 655.046503] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 655.046594] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47429a3-e05f-4e13-9450-6cfb300b5160 with Priority: HIGHEST for action port [ 655.048280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.048422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.048482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.048949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.049071] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.049927] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.050243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.050313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f47429a3-e05f-4e13-9450-6cfb300b5160 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.050599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.050599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.050736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.050736] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47429a3-e05f-4e13-9450-6cfb300b5160',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.291363] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.332251] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a45898c-36fc-4fcd-a0cf-5c78d804a157 [ 655.332389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.332489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.332549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.332771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.332860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.332970] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a45898c-36fc-4fcd-a0cf-5c78d804a157 already deleted. [ 655.333058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a45898c-36fc-4fcd-a0cf-5c78d804a157" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.364833] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.365266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.365266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.365440] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.365698] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.365848] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.365960] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.366189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.366630] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.366630] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.366630] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.367022] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.367022] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.367092] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.367342] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.367342] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.391224] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.391224] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.391224] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.391224] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.391541] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-164f1d3e-d69f-412d-8bdb-4498d41a2d88 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.391716] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.391833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.392500] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.392808] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164f1d3e-d69f-412d-8bdb-4498d41a2d88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.543656] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.554539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.554631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.554788] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f47429a3-e05f-4e13-9450-6cfb300b5160 with status ACTIVE [ 655.554964] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.555474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.555557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.555733] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.556052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.556124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.556300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.556388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.556448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.556664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.556664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.556760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f47429a3-e05f-4e13-9450-6cfb300b5160 is going to be updated. [ 655.577065] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.577166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.577236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.577458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.577596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.577784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f47429a3-e05f-4e13-9450-6cfb300b5160" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794101] env[69350]: INFO networking_nsxv3.common.synchronization [None req-47fd7370-50be-4880-a3ae-177367181252 tempest-ServersTestFqdnHostnames-1625487499 tempest-ServersTestFqdnHostnames-1625487499-project-member] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 655.794245] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.794349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.794417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.798042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.798042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.798042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be created. [ 655.798042] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 655.798042] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.798042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.798042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.798042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.798042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.828140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.828351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.828351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.831254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.831254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.840361] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: UNINITIALIZED for 2s [ 655.896507] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.896771] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.899355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.900324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.900324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.900324] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 164f1d3e-d69f-412d-8bdb-4498d41a2d88 not found, creating... [ 655.900613] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.900954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.901630] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.901990] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.902397] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.902464] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.902693] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.902744] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.902954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.903358] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.904470] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 164f1d3e-d69f-412d-8bdb-4498d41a2d88 is going to be created. [ 655.932871] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.932871] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.932871] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.933220] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.933220] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.933424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.045840] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.046437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.046437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.046437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.046682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.046682] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be created. [ 656.079170] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.079170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.079170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.079170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.079170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.101585] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: UNINITIALIZED for 2s [ 656.296298] env[69350]: INFO networking_nsxv3.common.synchronization [None req-abcdeb66-f4e4-482c-acee-b98c2fe456a6 tempest-ServersTestFqdnHostnames-1625487499 tempest-ServersTestFqdnHostnames-1625487499-project-member] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 656.297134] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 656.297533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.297654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.322290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.322434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.322478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.322726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.322810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.322903] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a already deleted. [ 656.322982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.323144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.323294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.323376] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.800635] env[69350]: INFO networking_nsxv3.common.synchronization [None req-ba854350-299f-450c-ad11-789dbef7b617 None None] Enqueued Resource ID: b8fe22f8-c607-490a-90a7-eb87283c548f with Priority: HIGHEST for action port [ 656.800913] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fe22f8-c607-490a-90a7-eb87283c548f with Priority: HIGHEST for action port [ 656.801821] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8fe22f8-c607-490a-90a7-eb87283c548f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.801987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8fe22f8-c607-490a-90a7-eb87283c548f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.801987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8fe22f8-c607-490a-90a7-eb87283c548f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.802684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8fe22f8-c607-490a-90a7-eb87283c548f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.802799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8fe22f8-c607-490a-90a7-eb87283c548f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.848222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.848222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.848222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.848222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.848222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.848222] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a already deleted. [ 656.848222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.864112] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a8b4cdf5-6b8d-4f12-9c11-65cb0b64ca07 None None] Enqueued Resource ID: 437d8f2e-af59-405d-9223-1b8495ee8698 with Priority: HIGHEST for action port [ 656.864112] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437d8f2e-af59-405d-9223-1b8495ee8698 with Priority: HIGHEST for action port [ 656.864815] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-437d8f2e-af59-405d-9223-1b8495ee8698 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.864815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-437d8f2e-af59-405d-9223-1b8495ee8698" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.864815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-437d8f2e-af59-405d-9223-1b8495ee8698" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.869028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-437d8f2e-af59-405d-9223-1b8495ee8698" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.869028] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437d8f2e-af59-405d-9223-1b8495ee8698',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.937025] env[69350]: INFO networking_nsxv3.common.synchronization [None req-24aeeb55-7b72-4c0f-b05b-6b78dd317d36 None None] Enqueued Resource ID: a6f88d23-b3d2-4c99-a27a-755adef10f54 with Priority: HIGHEST for action port [ 656.937025] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f88d23-b3d2-4c99-a27a-755adef10f54 with Priority: HIGHEST for action port [ 656.937025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f88d23-b3d2-4c99-a27a-755adef10f54 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.937025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f88d23-b3d2-4c99-a27a-755adef10f54" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.937025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f88d23-b3d2-4c99-a27a-755adef10f54" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.937025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f88d23-b3d2-4c99-a27a-755adef10f54" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.937025] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f88d23-b3d2-4c99-a27a-755adef10f54',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.306340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8fe22f8-c607-490a-90a7-eb87283c548f [ 657.306607] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.306697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.306766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.306987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.308016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.308168] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8fe22f8-c607-490a-90a7-eb87283c548f already deleted. [ 657.308275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8fe22f8-c607-490a-90a7-eb87283c548f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.368995] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 437d8f2e-af59-405d-9223-1b8495ee8698 [ 657.368995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.368995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.368995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.368995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.368995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.368995] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:437d8f2e-af59-405d-9223-1b8495ee8698 already deleted. [ 657.368995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-437d8f2e-af59-405d-9223-1b8495ee8698" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.439074] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6f88d23-b3d2-4c99-a27a-755adef10f54 [ 657.439320] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.439463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.439525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.439839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.439924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.440048] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6f88d23-b3d2-4c99-a27a-755adef10f54 already deleted. [ 657.440140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f88d23-b3d2-4c99-a27a-755adef10f54" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.548075] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a256c7c4-aa3f-455e-9817-8a966f87f16a None None] Enqueued Resource ID: 81bc64d9-3a20-416c-8dfe-ce08fdf74080 with Priority: HIGHEST for action port [ 657.548075] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bc64d9-3a20-416c-8dfe-ce08fdf74080 with Priority: HIGHEST for action port [ 657.548075] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-81bc64d9-3a20-416c-8dfe-ce08fdf74080 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.548075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81bc64d9-3a20-416c-8dfe-ce08fdf74080" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.548075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81bc64d9-3a20-416c-8dfe-ce08fdf74080" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.548075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81bc64d9-3a20-416c-8dfe-ce08fdf74080" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.548075] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81bc64d9-3a20-416c-8dfe-ce08fdf74080',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.575392] env[69350]: INFO networking_nsxv3.common.synchronization [req-d98acb82-6584-4d85-89c7-fe4f7bd74b9e req-c389978f-3cdd-40f5-927e-086f5df9ab57 tempest-ServerDiagnosticsNegativeTest-503426299 tempest-ServerDiagnosticsNegativeTest-503426299-project-member] Enqueued Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 657.575392] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 657.575392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.575392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.575392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.575392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.575392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.578660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.578660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.578831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.578924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.579078] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.793872] env[69350]: INFO networking_nsxv3.common.synchronization [None req-82c4c002-e848-4603-bb55-30cdc935cbd2 None None] Enqueued Resource ID: fb93480e-f2b6-49a4-866c-321d679a3962 with Priority: HIGHEST for action port [ 657.794747] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb93480e-f2b6-49a4-866c-321d679a3962 with Priority: HIGHEST for action port [ 657.795111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb93480e-f2b6-49a4-866c-321d679a3962 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.795246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb93480e-f2b6-49a4-866c-321d679a3962" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.795311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb93480e-f2b6-49a4-866c-321d679a3962" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.795583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb93480e-f2b6-49a4-866c-321d679a3962" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.795663] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb93480e-f2b6-49a4-866c-321d679a3962',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.818098] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a72f8e9c-a773-4f14-b40d-714cb3cffdc9 None None] Enqueued Resource ID: e0847ce9-327a-4b1a-9857-3eb927fe4bbc with Priority: HIGHEST for action port [ 657.818810] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0847ce9-327a-4b1a-9857-3eb927fe4bbc with Priority: HIGHEST for action port [ 657.819381] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0847ce9-327a-4b1a-9857-3eb927fe4bbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.819507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0847ce9-327a-4b1a-9857-3eb927fe4bbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.819563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0847ce9-327a-4b1a-9857-3eb927fe4bbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.824099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0847ce9-327a-4b1a-9857-3eb927fe4bbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.824229] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0847ce9-327a-4b1a-9857-3eb927fe4bbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.839617] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-b7cf5b6d-e713-4444-84f2-e2575cf46f46 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 657.839791] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-b7cf5b6d-e713-4444-84f2-e2575cf46f46 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 657.839937] env[69350]: INFO networking_nsxv3.common.synchronization [req-08553916-1080-4760-8e81-79bf049c1633 req-b7cf5b6d-e713-4444-84f2-e2575cf46f46 service nova] Enqueued Resource ID: 164f1d3e-d69f-412d-8bdb-4498d41a2d88 with Priority: HIGHEST for action port [ 657.840671] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 657.840807] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 657.840926] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164f1d3e-d69f-412d-8bdb-4498d41a2d88 with Priority: HIGHEST for action port [ 657.843722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.843838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.844086] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.844172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.845139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-164f1d3e-d69f-412d-8bdb-4498d41a2d88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.845219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.845285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.846457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.846538] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164f1d3e-d69f-412d-8bdb-4498d41a2d88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.860049] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 657.862127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.863084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.863362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.863603] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.863814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.863924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.864159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.864252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.864345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.864466] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.050745] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81bc64d9-3a20-416c-8dfe-ce08fdf74080 [ 658.050745] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.050745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.050745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.050974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.051016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.051129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81bc64d9-3a20-416c-8dfe-ce08fdf74080 already deleted. [ 658.051247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81bc64d9-3a20-416c-8dfe-ce08fdf74080" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.081910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.083603] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.083603] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 already deleted. [ 658.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.112041] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 658.112294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.112432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.112884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.112884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.113072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.113072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.113473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.113473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.113473] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.300182] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb93480e-f2b6-49a4-866c-321d679a3962 [ 658.300182] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.300182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.300182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.300182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.300182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.300182] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb93480e-f2b6-49a4-866c-321d679a3962 already deleted. [ 658.300182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb93480e-f2b6-49a4-866c-321d679a3962" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.328129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0847ce9-327a-4b1a-9857-3eb927fe4bbc [ 658.328129] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.328129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.328129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.328129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.328129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.328129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0847ce9-327a-4b1a-9857-3eb927fe4bbc already deleted. [ 658.328129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0847ce9-327a-4b1a-9857-3eb927fe4bbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.353925] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 164f1d3e-d69f-412d-8bdb-4498d41a2d88 with status ACTIVE [ 658.353925] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.353925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.353925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.354190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.354286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.354499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.354649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.354716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.354917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.354986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.355209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.355406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.355472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.356150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.356150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.356150] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 164f1d3e-d69f-412d-8bdb-4498d41a2d88 is going to be updated. [ 658.368374] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.368550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.368584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.369174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.369174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.369174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.369424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.369604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.369704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.369789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.370945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.371456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.371588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.371824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.372010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.372152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.372255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.372660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.372660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.372660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.372795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.381726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.381866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.381941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.382225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.383024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.383024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-164f1d3e-d69f-412d-8bdb-4498d41a2d88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.620610] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.746422] env[69350]: INFO networking_nsxv3.common.synchronization [None req-dbed195d-1826-4ead-b754-226f659126b8 tempest-VolumesAssistedSnapshotsTest-1004854712 tempest-VolumesAssistedSnapshotsTest-1004854712-project-member] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 658.746568] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 658.746817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.746935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.746999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.749966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.750100] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.874991] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3ca168c-7530-47a3-aa0d-a5c0012eaf61: rpc.has_security_group_logging(os_id): False [ 658.907457] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.907585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.907642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.909679] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.909679] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.909679] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.909679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.910529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.910529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.910529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.910529] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be created. [ 658.963501] env[69350]: INFO networking_nsxv3.common.synchronization [None req-18eea763-2a67-4a8e-a941-a64ee3acb2f3 tempest-VolumesAssistedSnapshotsTest-1004854712 tempest-VolumesAssistedSnapshotsTest-1004854712-project-member] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 658.963501] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 658.963501] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.963501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.004791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.004791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.004791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.004791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.004791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.019534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 659.123753] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.290644] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.290644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.290898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.291382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.291382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.291382] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 already deleted. [ 659.291541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.291583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.291792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.291851] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.416259] env[69350]: INFO networking_nsxv3.common.synchronization [req-30c2e102-aa71-4f15-928c-4b63fd864a5e req-78dd223a-57c7-4134-b824-3b4ae22a2be6 tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 659.419274] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 659.420942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.421128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.421194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.421497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.422046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.422046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.422046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.422046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.422782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.422887] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.436523] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.436523] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.436690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.437036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.437317] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.437466] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.437659] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.437924] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.438175] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.438376] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.438813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.438813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.440127] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.440127] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.440127] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.440127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.461875] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.462082] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.465020] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.465020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.465020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-ba8ab886-b89d-4bf8-862d-e629aa995d4f taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.465020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.465020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.465020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.465020] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8ab886-b89d-4bf8-862d-e629aa995d4f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.629101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.629101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.629101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.629317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.629503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.629503] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 659.667098] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.669326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.669326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.669326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.669326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.679741] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 659.813613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.813864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.813864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.814038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.814169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.814229] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 already deleted. [ 659.814334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.928557] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.928754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.928831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.930090] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.930090] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 already deleted. [ 659.930090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.968972] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.968972] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port ba8ab886-b89d-4bf8-862d-e629aa995d4f not found, creating... [ 659.968972] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.968972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.969368] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.970341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.970878] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.971414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.971720] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.972217] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: ba8ab886-b89d-4bf8-862d-e629aa995d4f is going to be created. [ 660.005071] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.005071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.005071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.005071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.005071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.005071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.257127] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.257127] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.257127] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.257127] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.257127] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.257127] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.257127] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.259641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.259641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.259641] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.259641] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.259641] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.259641] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.259641] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.259997] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.260279] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.322197] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.322444] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.062 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.322617] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.322840] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.323208] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4bd448be-f6d6-44c9-a092-e3001a0b0f34 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.323399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.323514] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.323850] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.323992] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd448be-f6d6-44c9-a092-e3001a0b0f34',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.411991] env[69350]: INFO networking_nsxv3.common.synchronization [None req-994b9d50-db1e-4e45-9d86-0c0690d86ec2 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 660.411991] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 660.418026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.418341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.418341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.418453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.418534] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.830138] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.830138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.830138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.830138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.830138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.830138] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4bd448be-f6d6-44c9-a092-e3001a0b0f34 not found, creating... [ 660.831380] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.831380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.831380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.831380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.831380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.831380] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.832422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.832586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.832817] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.833050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.833122] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4bd448be-f6d6-44c9-a092-e3001a0b0f34 is going to be created. [ 660.852466] env[69350]: INFO networking_nsxv3.common.synchronization [None req-dd1552fa-0139-4901-b6c0-9e7b8f9a4ff6 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 660.852466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 660.852466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.852466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.863586] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.863586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.863586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.863586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.863928] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.864094] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.944518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.944518] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b already deleted. [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.944518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.944518] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.046993] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 661.049855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.094295] env[69350]: INFO networking_nsxv3.common.synchronization [req-f42facc0-5f2b-4bb1-afe7-ec1a85a32ea6 req-73ee606a-9d44-470c-ad77-7d70ce7baa8f tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 661.094295] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 661.094295] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.095553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.095657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.095862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.096146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.096268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.096340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.096745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.096834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.096940] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.469469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.469866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.469866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.469866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.469966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.470039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b already deleted. [ 661.470345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.599073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.599073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.599256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.599376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.599505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.599714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.599812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.599875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.600057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.600135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.600240] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 already deleted. [ 661.600295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.693752] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 661.694560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.694816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.695070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.695347] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.696121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.696205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.697057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.697189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.697226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.697363] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.698349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.698851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.699974] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.699974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.699974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.699974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.699974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.699974] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.028040] env[69350]: INFO networking_nsxv3.common.synchronization [req-d98acb82-6584-4d85-89c7-fe4f7bd74b9e req-f3fbddaa-9133-472d-87da-488406cc26e0 service nova] Enqueued Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_rules [ 662.028234] env[69350]: INFO networking_nsxv3.common.synchronization [req-d98acb82-6584-4d85-89c7-fe4f7bd74b9e req-f3fbddaa-9133-472d-87da-488406cc26e0 service nova] Enqueued Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 662.028415] env[69350]: INFO networking_nsxv3.common.synchronization [req-d98acb82-6584-4d85-89c7-fe4f7bd74b9e req-f3fbddaa-9133-472d-87da-488406cc26e0 service nova] Enqueued Resource ID: ba8ab886-b89d-4bf8-862d-e629aa995d4f with Priority: HIGHEST for action port [ 662.029153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_rules [ 662.029153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 662.029153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8ab886-b89d-4bf8-862d-e629aa995d4f with Priority: HIGHEST for action port [ 662.030022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.030199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.030319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.030644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.030924] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.032160] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.032160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.032160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.032160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.033127] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.033487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.033556] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.033729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.033822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.034522] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.034713] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8ab886-b89d-4bf8-862d-e629aa995d4f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.034825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.034891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.035122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.035210] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8ab886-b89d-4bf8-862d-e629aa995d4f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.202074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.202477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.204506] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.449319] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.449512] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.449642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.450082] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.451186] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.451186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.451186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.451186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.451455] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.451557] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.451681] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.451789] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.451897] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.452024] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.452133] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.452265] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.471311] env[69350]: INFO networking_nsxv3.common.synchronization [req-a27c0244-4c54-47a0-8dc7-268034e3ecfb req-3afe6c90-2da0-42ec-ad58-55b45be264ea tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: e32f45b3-0629-475b-863b-4ff4af8cfae1 with Priority: HIGHEST for action security_group_rules [ 662.471311] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32f45b3-0629-475b-863b-4ff4af8cfae1 with Priority: HIGHEST for action security_group_rules [ 662.471646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e32f45b3-0629-475b-863b-4ff4af8cfae1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.471707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e32f45b3-0629-475b-863b-4ff4af8cfae1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.471893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e32f45b3-0629-475b-863b-4ff4af8cfae1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.472178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e32f45b3-0629-475b-863b-4ff4af8cfae1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.472274] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e32f45b3-0629-475b-863b-4ff4af8cfae1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.474822] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.474946] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.475100] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.475282] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.475577] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-d1f98921-b0c5-4236-adb2-81590cb6fd1a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.475747] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.475871] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.476216] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.476516] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1f98921-b0c5-4236-adb2-81590cb6fd1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.483782] env[69350]: INFO networking_nsxv3.common.synchronization [req-30c2e102-aa71-4f15-928c-4b63fd864a5e req-606e6576-c6cc-4af9-91a4-f667b73f7620 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 662.483960] env[69350]: INFO networking_nsxv3.common.synchronization [req-30c2e102-aa71-4f15-928c-4b63fd864a5e req-606e6576-c6cc-4af9-91a4-f667b73f7620 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 662.484110] env[69350]: INFO networking_nsxv3.common.synchronization [req-30c2e102-aa71-4f15-928c-4b63fd864a5e req-606e6576-c6cc-4af9-91a4-f667b73f7620 service nova] Enqueued Resource ID: 4bd448be-f6d6-44c9-a092-e3001a0b0f34 with Priority: HIGHEST for action port [ 662.484336] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 662.484455] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 662.484546] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bd448be-f6d6-44c9-a092-e3001a0b0f34 with Priority: HIGHEST for action port [ 662.485059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.485187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.485254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.485492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.485575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.490966] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.491239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.491239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.491394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.491620] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.491763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.491763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.491986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.491986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.492086] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.492985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bd448be-f6d6-44c9-a092-e3001a0b0f34 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.492985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.493908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.493908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.493908] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd448be-f6d6-44c9-a092-e3001a0b0f34',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.537494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.537637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.537839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.539918] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba8ab886-b89d-4bf8-862d-e629aa995d4f with status ACTIVE [ 662.539918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.539918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.539918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.539918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.539918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.539918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.540250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.540838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.540989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.541110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.541288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.541717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.541717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.541717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.541717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.541878] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba8ab886-b89d-4bf8-862d-e629aa995d4f is going to be updated. [ 662.546182] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4dd5b66b-ab01-49d1-a880-4bfb093095e5 None None] Enqueued Resource ID: 88f97ba9-a968-4506-b496-415474a13ce0 with Priority: HIGHEST for action port [ 662.547477] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f97ba9-a968-4506-b496-415474a13ce0 with Priority: HIGHEST for action port [ 662.547477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f97ba9-a968-4506-b496-415474a13ce0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.547477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f97ba9-a968-4506-b496-415474a13ce0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.547724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f97ba9-a968-4506-b496-415474a13ce0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.547756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f97ba9-a968-4506-b496-415474a13ce0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.547832] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f97ba9-a968-4506-b496-415474a13ce0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.570424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.570572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.570640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.571455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.572434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.572434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8ab886-b89d-4bf8-862d-e629aa995d4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.710228] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.925537] env[69350]: INFO networking_nsxv3.common.synchronization [None req-fd6b299c-d242-4a43-83dc-2c13128af82e None None] Enqueued Resource ID: ac922675-db64-4e37-9eee-f80e2a56ca18 with Priority: HIGHEST for action port [ 662.926162] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac922675-db64-4e37-9eee-f80e2a56ca18 with Priority: HIGHEST for action port [ 662.927472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac922675-db64-4e37-9eee-f80e2a56ca18 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.927472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac922675-db64-4e37-9eee-f80e2a56ca18" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.927638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac922675-db64-4e37-9eee-f80e2a56ca18" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.928926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac922675-db64-4e37-9eee-f80e2a56ca18" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.928926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac922675-db64-4e37-9eee-f80e2a56ca18',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.982156] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.982156] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port d1f98921-b0c5-4236-adb2-81590cb6fd1a not found, creating... [ 662.982156] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.982156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.983146] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.983146] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.983146] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.983146] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.983146] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.983146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: d1f98921-b0c5-4236-adb2-81590cb6fd1a is going to be created. [ 663.000333] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bd448be-f6d6-44c9-a092-e3001a0b0f34 with status ACTIVE [ 663.000333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.000333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.000333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.000333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.000333] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bd448be-f6d6-44c9-a092-e3001a0b0f34 is going to be updated. [ 663.002111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.002466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.002753] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.006298] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.007425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.007667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.007968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.008188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.008366] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e32f45b3-0629-475b-863b-4ff4af8cfae1 already deleted. [ 663.008527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e32f45b3-0629-475b-863b-4ff4af8cfae1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.038072] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.038072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.038072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.038072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.038072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.038072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.041349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.042044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.042299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.042674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.042928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.043339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bd448be-f6d6-44c9-a092-e3001a0b0f34" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.044574] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.049830] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88f97ba9-a968-4506-b496-415474a13ce0 [ 663.050093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.050244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.050635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.051254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.051254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.051254] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88f97ba9-a968-4506-b496-415474a13ce0 already deleted. [ 663.051254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f97ba9-a968-4506-b496-415474a13ce0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.213517] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.216367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.216367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.216367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.216367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.216367] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 663.264370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.264370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.264370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.264370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.264370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.278686] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 663.386353] env[69350]: INFO networking_nsxv3.common.synchronization [None req-fdc48e58-61bd-4140-ae49-1025929309f4 None None] Enqueued Resource ID: 29bd85b1-7b7a-4392-88ee-bec8eabc28da with Priority: HIGHEST for action port [ 663.387267] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29bd85b1-7b7a-4392-88ee-bec8eabc28da with Priority: HIGHEST for action port [ 663.387764] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-29bd85b1-7b7a-4392-88ee-bec8eabc28da taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.388224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29bd85b1-7b7a-4392-88ee-bec8eabc28da" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.388862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29bd85b1-7b7a-4392-88ee-bec8eabc28da" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.388862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29bd85b1-7b7a-4392-88ee-bec8eabc28da" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.388862] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29bd85b1-7b7a-4392-88ee-bec8eabc28da',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.395203] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0e16007f-d1a7-4dda-8de7-d703532f9c7f tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 663.396503] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 663.397153] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.397825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.397825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.398181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.398181] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.432317] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac922675-db64-4e37-9eee-f80e2a56ca18 [ 663.432317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.432317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.432317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.432317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.432317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.432317] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac922675-db64-4e37-9eee-f80e2a56ca18 already deleted. [ 663.432317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac922675-db64-4e37-9eee-f80e2a56ca18" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.510420] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.547300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.547451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.547521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.547954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.549069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.549069] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 is going to be created. [ 663.573467] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.573634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.573723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.573968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.574173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.588154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: UNINITIALIZED for 2s [ 663.897333] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29bd85b1-7b7a-4392-88ee-bec8eabc28da [ 663.897443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.898432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.898432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.898432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.898432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.898432] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29bd85b1-7b7a-4392-88ee-bec8eabc28da already deleted. [ 663.898432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29bd85b1-7b7a-4392-88ee-bec8eabc28da" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.926874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.927771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.929921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.930688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.930984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.932739] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a already deleted. [ 663.932739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.015963] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.015963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.015963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.015963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.015963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.016735] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be created. [ 664.045497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.046111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.046111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.046111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.046285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.070649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: UNINITIALIZED for 2s [ 664.289993] env[69350]: INFO networking_nsxv3.common.synchronization [None req-19fcaf8c-e6c9-4f70-a292-272b259ee8d2 tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 664.290557] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 664.292427] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.292592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.292662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.292912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.292979] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.815323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.815781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.815781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.815781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.815983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.815983] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a already deleted. [ 664.816112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.290271] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 665.290642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.290852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.291137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.291296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.291417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.291482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.291644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.291736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.291812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.291973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.292086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.292211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.292472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.293429] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.293429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.293429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.293429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.293644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.294010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.294010] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.532715] env[69350]: INFO networking_nsxv3.common.synchronization [req-f42facc0-5f2b-4bb1-afe7-ec1a85a32ea6 req-35a8e42e-5685-44e5-b3a3-fc998de8fc70 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 665.532921] env[69350]: INFO networking_nsxv3.common.synchronization [req-f42facc0-5f2b-4bb1-afe7-ec1a85a32ea6 req-35a8e42e-5685-44e5-b3a3-fc998de8fc70 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 665.533078] env[69350]: INFO networking_nsxv3.common.synchronization [req-f42facc0-5f2b-4bb1-afe7-ec1a85a32ea6 req-35a8e42e-5685-44e5-b3a3-fc998de8fc70 service nova] Enqueued Resource ID: d1f98921-b0c5-4236-adb2-81590cb6fd1a with Priority: HIGHEST for action port [ 665.533357] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 665.533470] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 665.533586] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f98921-b0c5-4236-adb2-81590cb6fd1a with Priority: HIGHEST for action port [ 665.536832] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.537024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.537246] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.537348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.537546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1f98921-b0c5-4236-adb2-81590cb6fd1a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.537644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.537710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.537914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.538070] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1f98921-b0c5-4236-adb2-81590cb6fd1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.599707] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: SUCCESS [ 665.599953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.600196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.600467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.600688] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.600853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.600910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.601119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.601223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.601313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.601477] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.796784] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44290e3f-7c0d-4bde-a194-fd1b6df88740: rpc.has_security_group_logging(os_id): False [ 665.818035] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.818385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.818385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.818563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.818627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.818831] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.818942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.819333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.819862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.820030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.820100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.820256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.820343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.820579] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.820694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.820766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.822018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.822018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.823206] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be created. [ 665.894800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.894800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.894800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.895486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.895711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.908663] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 666.040838] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1f98921-b0c5-4236-adb2-81590cb6fd1a with status ACTIVE [ 666.041048] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.041188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.041259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.041481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.041574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.041749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.041863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.041908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.042191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.042191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.042333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.042413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.042475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.042619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.042693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.042778] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1f98921-b0c5-4236-adb2-81590cb6fd1a is going to be updated. [ 666.065187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.065595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.065595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.065760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.065908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.066152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1f98921-b0c5-4236-adb2-81590cb6fd1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.084010] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 666.084282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.084456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.084675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.084896] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.085035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.085104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.085304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.085433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.085560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.085669] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.087733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.087965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.088213] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.088588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.089416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.089644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.089777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.089909] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.103557] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.103712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.103789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.104036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.104985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.104985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.104985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.104985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.104985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.105266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.105418] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.105418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.105520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.105808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.105808] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.105972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.105972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.107121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.107121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.107121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.107121] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.594229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.594431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.597912] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.608373] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acb732d8-60aa-4ed8-8944-d466f3eaa2e2: rpc.has_security_group_logging(os_id): False [ 666.638546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.638699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.638758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.638971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.639068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.639341] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.639465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.639524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.639734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.639806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.642031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.643284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.643284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.643519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.643620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.643905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.644037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.644096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.644250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.644335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.644410] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 is going to be created. [ 666.719326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.719521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.719555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.719806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.720035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.738656] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: IN_PROGRESS for 2s [ 667.106791] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.614950] env[69350]: INFO networking_nsxv3.common.synchronization [None req-2630a210-ebc7-4a92-a421-c145caaa9759 None None] Enqueued Resource ID: 3df35ebb-9a5e-4abc-bca2-61dc049218ac with Priority: HIGHEST for action port [ 667.614950] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df35ebb-9a5e-4abc-bca2-61dc049218ac with Priority: HIGHEST for action port [ 667.619356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-3df35ebb-9a5e-4abc-bca2-61dc049218ac taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.619356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3df35ebb-9a5e-4abc-bca2-61dc049218ac" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.619356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3df35ebb-9a5e-4abc-bca2-61dc049218ac" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.619356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3df35ebb-9a5e-4abc-bca2-61dc049218ac" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.619356] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3df35ebb-9a5e-4abc-bca2-61dc049218ac',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.619821] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.619934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.619999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.620202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.620307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.621329] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 667.660631] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.660739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.660841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.661020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.661169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.674808] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 667.686221] env[69350]: INFO networking_nsxv3.common.synchronization [req-9a526011-ab73-4c27-94d3-7aeae223ea7c req-b65aa533-6002-40ef-9687-c93414310e31 tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: 5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed with Priority: HIGHEST for action security_group_rules [ 667.688694] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed with Priority: HIGHEST for action security_group_rules [ 667.691398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.692046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.692046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.693692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.693692] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.927680] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 667.927838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.928067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.928705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.928705] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.124923] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3df35ebb-9a5e-4abc-bca2-61dc049218ac [ 668.125259] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.125259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.126658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.126658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.126658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.126658] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3df35ebb-9a5e-4abc-bca2-61dc049218ac already deleted. [ 668.126658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3df35ebb-9a5e-4abc-bca2-61dc049218ac" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.216241] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.216399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.216835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.216835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.216835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.216962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed already deleted. [ 668.216962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e4bb3e4-bdb1-4ce0-995e-dfe148b222ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.343479] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4e84a9b1-5d1a-4b00-875e-84c276cbc7f5 None None] Enqueued Resource ID: 42ea00b0-f872-42da-be6d-9f5673518051 with Priority: HIGHEST for action port [ 668.344259] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ea00b0-f872-42da-be6d-9f5673518051 with Priority: HIGHEST for action port [ 668.344591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-42ea00b0-f872-42da-be6d-9f5673518051 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.344759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42ea00b0-f872-42da-be6d-9f5673518051" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.344793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42ea00b0-f872-42da-be6d-9f5673518051" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.345486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42ea00b0-f872-42da-be6d-9f5673518051" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.345628] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42ea00b0-f872-42da-be6d-9f5673518051',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.434454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.434454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434454] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.456027] env[69350]: INFO networking_nsxv3.common.synchronization [req-bf52a030-a06f-43bb-85f0-a52c3f252062 req-858c6df2-60a4-40b8-920f-73659ec80f70 tempest-ServersAdminNegativeTestJSON-1789430876 tempest-ServersAdminNegativeTestJSON-1789430876-project-member] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 668.456463] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 668.456885] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.457508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.457670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.458045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.458337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.458607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.458781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.459058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.459920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.460151] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.752320] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: SUCCESS [ 668.752536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.780644] env[69350]: INFO networking_nsxv3.common.synchronization [None req-cef00c1f-b755-46fa-8b44-4f6946399a3a None None] Enqueued Resource ID: 93d16071-772c-434b-9c55-3dd2338a76b5 with Priority: HIGHEST for action port [ 668.781321] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d16071-772c-434b-9c55-3dd2338a76b5 with Priority: HIGHEST for action port [ 668.781739] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-93d16071-772c-434b-9c55-3dd2338a76b5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.781865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93d16071-772c-434b-9c55-3dd2338a76b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.781936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93d16071-772c-434b-9c55-3dd2338a76b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.783403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93d16071-772c-434b-9c55-3dd2338a76b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.783403] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93d16071-772c-434b-9c55-3dd2338a76b5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.851680] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42ea00b0-f872-42da-be6d-9f5673518051 [ 668.852016] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.852201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.852273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.852537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.852648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.852766] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42ea00b0-f872-42da-be6d-9f5673518051 already deleted. [ 668.852862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42ea00b0-f872-42da-be6d-9f5673518051" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.938159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.938385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.938575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.939853] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.939853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.939853] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.940772] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.940772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.940772] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.962506] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.962710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.962786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.963212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.963522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.963774] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.963909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.963973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.964257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.964388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.964538] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 already deleted. [ 668.965364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.287962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93d16071-772c-434b-9c55-3dd2338a76b5 [ 669.287962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.287962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.287962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.287962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.287962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.287962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93d16071-772c-434b-9c55-3dd2338a76b5 already deleted. [ 669.287962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93d16071-772c-434b-9c55-3dd2338a76b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.447180] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44290e3f-7c0d-4bde-a194-fd1b6df88740: rpc.has_security_group_logging(os_id): False [ 669.469089] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.469387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.469547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.469887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.470074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.470366] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.470522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.470651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.470928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.473131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.474409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.474409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.474409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.474409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.474409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.474622] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.474667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.474740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.474966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.475096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.475227] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 669.544599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.546514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.546514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.546514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.546514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.560384] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 669.689287] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.689287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.689287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.689287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.689287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.690021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.690246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.690722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.691123] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.893555] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.893847] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.894791] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.895783] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.895783] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.895928] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.896041] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.897083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.897083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.900483] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.900917] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.901134] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.901312] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.901487] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.901680] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.902618] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.923765] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.924326] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.924326] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.924326] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.924622] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.924802] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.924870] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.928435] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.928435] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c30bf2-ae08-48fd-94f8-0ce89b6cf663',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.131998] env[69350]: INFO networking_nsxv3.common.synchronization [req-0385a264-acac-4567-860a-a9b40bbffd15 req-d119c450-017d-4280-8d8e-0662dbb9737a tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 670.133484] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 670.133484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.133795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.133795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.135185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.135185] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.135185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.135185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.135185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.135185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.135185] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.193563] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a07d8013-92b1-46a1-acb2-34b3df1ac235: rpc.has_security_group_logging(os_id): False [ 670.214828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.214997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.215515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.215515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.215515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.215705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.215790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.215854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.216021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.216098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.216291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.216383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.216456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.216716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.216716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.216924] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.217730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.217888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.218114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.218250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.218379] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be created. [ 670.288672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.289059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.289059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.289199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.289364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.305087] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 670.316389] env[69350]: INFO networking_nsxv3.common.synchronization [None req-56df21d8-0e29-496e-9738-331bbd1c0229 tempest-ServersTestJSON-666805160 tempest-ServersTestJSON-666805160-project-member] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 670.317307] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 670.317836] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.317836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.318022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.319696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.320758] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.428108] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.428488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.428715] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.431472] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.431736] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.431977] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 not found, creating... [ 670.432614] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.432888] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.435134] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.435430] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.435664] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.436874] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.436874] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.436874] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.437152] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.437788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.438076] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 is going to be created. [ 670.462752] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.464155] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.465143] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.465520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.465766] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.466080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.537110] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c8a23d3c-725e-4b1d-a816-b01cf1ed7f5b tempest-ServersTestJSON-666805160 tempest-ServersTestJSON-666805160-project-member] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 670.537110] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 670.538120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.538255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.638320] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.638535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.638632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.639029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.639029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.639282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.639419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.639506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.639719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.639805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.639893] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 already deleted. [ 670.639995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.661996] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4d12e9ec-e68c-4706-adff-3285679d0664 None None] Enqueued Resource ID: b1a8fec5-ae64-4827-a13d-018958d3bbdc with Priority: HIGHEST for action port [ 670.662330] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a8fec5-ae64-4827-a13d-018958d3bbdc with Priority: HIGHEST for action port [ 670.662935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a8fec5-ae64-4827-a13d-018958d3bbdc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.664082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a8fec5-ae64-4827-a13d-018958d3bbdc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.664082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a8fec5-ae64-4827-a13d-018958d3bbdc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.664082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a8fec5-ae64-4827-a13d-018958d3bbdc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.664082] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a8fec5-ae64-4827-a13d-018958d3bbdc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.854751] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.854751] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 already deleted. [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.854751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.854751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.171638] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1a8fec5-ae64-4827-a13d-018958d3bbdc [ 671.172123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.172287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.172390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.172968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.172968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.172968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1a8fec5-ae64-4827-a13d-018958d3bbdc already deleted. [ 671.172968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a8fec5-ae64-4827-a13d-018958d3bbdc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.383676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.383676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.383676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.383676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.383676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.383676] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 already deleted. [ 671.383676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.398833] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.399055] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.399269] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.399629] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.399886] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.400878] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.401199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.402231] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.402520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.403813] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.403813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.403813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.403813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.403813] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.403813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.403813] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.427076] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.427344] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.427516] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.428135] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.428135] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4b02a051-22c0-400f-ae3f-121acecbb02e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.428371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.428371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.429332] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.429514] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b02a051-22c0-400f-ae3f-121acecbb02e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.576891] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 671.576891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.663979] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d4ff89ca-918d-4fff-b252-045e044f3a02 None None] Enqueued Resource ID: 8bc33654-396d-4c85-a826-96a6fcaa13cd with Priority: HIGHEST for action port [ 671.665105] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bc33654-396d-4c85-a826-96a6fcaa13cd with Priority: HIGHEST for action port [ 671.665105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bc33654-396d-4c85-a826-96a6fcaa13cd taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.665105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bc33654-396d-4c85-a826-96a6fcaa13cd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.672544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bc33654-396d-4c85-a826-96a6fcaa13cd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.672544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bc33654-396d-4c85-a826-96a6fcaa13cd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.672544] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc33654-396d-4c85-a826-96a6fcaa13cd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.893191] env[69350]: INFO networking_nsxv3.common.synchronization [req-bf52a030-a06f-43bb-85f0-a52c3f252062 req-08cd20aa-f647-410f-b77f-db75ac564f78 service nova] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_rules [ 671.893303] env[69350]: INFO networking_nsxv3.common.synchronization [req-bf52a030-a06f-43bb-85f0-a52c3f252062 req-08cd20aa-f647-410f-b77f-db75ac564f78 service nova] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 671.893568] env[69350]: INFO networking_nsxv3.common.synchronization [req-bf52a030-a06f-43bb-85f0-a52c3f252062 req-08cd20aa-f647-410f-b77f-db75ac564f78 service nova] Enqueued Resource ID: c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 with Priority: HIGHEST for action port [ 671.893714] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_rules [ 671.893832] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 671.893886] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 with Priority: HIGHEST for action port [ 671.894530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.894699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.894747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.895037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.895094] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.895969] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.896344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.896344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.896448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.899017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.899017] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.899017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.899017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.899017] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c30bf2-ae08-48fd-94f8-0ce89b6cf663',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.933350] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.933350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.933350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.933350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.933350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.933658] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4b02a051-22c0-400f-ae3f-121acecbb02e not found, creating... [ 671.933995] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.934289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.934955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.934955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.934955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.935299] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.935524] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.935660] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.935924] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.936150] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936405] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4b02a051-22c0-400f-ae3f-121acecbb02e is going to be created. [ 671.965389] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.965690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.965766] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.966130] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.966395] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.966690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.174857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bc33654-396d-4c85-a826-96a6fcaa13cd [ 672.175035] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.175180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.175302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.175457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.175540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.175632] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bc33654-396d-4c85-a826-96a6fcaa13cd already deleted. [ 672.175754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bc33654-396d-4c85-a826-96a6fcaa13cd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.311922] env[69350]: INFO networking_nsxv3.common.synchronization [req-192e8966-58fc-4a28-acfd-7fec176ef7bf req-b77aaa8e-10cd-4a56-a758-b30c3a612ddf tempest-ServersTestFqdnHostnames-1625487499 tempest-ServersTestFqdnHostnames-1625487499-project-member] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 672.312585] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 672.312907] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.313079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.313304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.313510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.313673] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.313776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.313838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.313996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.314164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.314222] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.322346] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 672.322588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.323116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.323358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.323437] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.401276] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.401767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.401839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.407084] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 with status ACTIVE [ 672.407084] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.408780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.408780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.410219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.410381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.410599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.410702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.410754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.410936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.411016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.411106] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5c30bf2-ae08-48fd-94f8-0ce89b6cf663 is going to be updated. [ 672.440478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.440478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.440478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.440478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.440478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.440478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5c30bf2-ae08-48fd-94f8-0ce89b6cf663" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.817807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.818017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.818017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.818303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.818653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.818748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.818875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.819196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.819277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.820647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.820647] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a already deleted. [ 672.820647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.827828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.828136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.828302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.828442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.828685] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.828808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.828876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.829216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.829216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.829337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.829337] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.912690] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.336142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.336142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.336142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.336142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.336142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.338151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.338151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.338151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.338151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.338151] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.421452] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.421452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.421452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.421452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.421452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.421452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be created. [ 673.449814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.452030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.452030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.452030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.452030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.467254] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: UNINITIALIZED for 2s [ 673.537186] env[69350]: INFO networking_nsxv3.common.synchronization [None req-8d176996-2153-494e-975a-7bb80292fc60 None None] Enqueued Resource ID: 178642c9-c814-474a-bcc9-4bf40837f7b3 with Priority: HIGHEST for action port [ 673.537186] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 178642c9-c814-474a-bcc9-4bf40837f7b3 with Priority: HIGHEST for action port [ 673.537186] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-178642c9-c814-474a-bcc9-4bf40837f7b3 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.537186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-178642c9-c814-474a-bcc9-4bf40837f7b3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.537186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-178642c9-c814-474a-bcc9-4bf40837f7b3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.537186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-178642c9-c814-474a-bcc9-4bf40837f7b3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.537186] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('178642c9-c814-474a-bcc9-4bf40837f7b3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.593206] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.593425] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.593553] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.593918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.594216] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.594378] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.594500] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.594726] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.594877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.596705] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.596909] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.597070] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.597245] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.597602] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.597750] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.597913] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.619734] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.619959] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.622412] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.622412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.622412] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c86c212e-2e56-4561-a254-215ae27a7b86 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.622412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.622412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.622412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.622412] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86c212e-2e56-4561-a254-215ae27a7b86',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.652608] env[69350]: INFO networking_nsxv3.common.synchronization [req-0385a264-acac-4567-860a-a9b40bbffd15 req-dcb84e82-e338-428d-b926-377560ee2a3c service nova] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 673.652931] env[69350]: INFO networking_nsxv3.common.synchronization [req-0385a264-acac-4567-860a-a9b40bbffd15 req-dcb84e82-e338-428d-b926-377560ee2a3c service nova] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 673.653017] env[69350]: INFO networking_nsxv3.common.synchronization [req-0385a264-acac-4567-860a-a9b40bbffd15 req-dcb84e82-e338-428d-b926-377560ee2a3c service nova] Enqueued Resource ID: 4b02a051-22c0-400f-ae3f-121acecbb02e with Priority: HIGHEST for action port [ 673.653393] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_rules [ 673.653393] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 673.653504] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b02a051-22c0-400f-ae3f-121acecbb02e with Priority: HIGHEST for action port [ 673.654036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.655588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.655987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.655987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.655987] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.657117] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.657293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.657472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.657842] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.658023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.658262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.658366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.658460] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.664095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b02a051-22c0-400f-ae3f-121acecbb02e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.664095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.664095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.664095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.664095] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b02a051-22c0-400f-ae3f-121acecbb02e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.839857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a07d8013-92b1-46a1-acb2-34b3df1ac235: rpc.has_security_group_logging(os_id): False [ 673.864022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.864022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.864022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.864022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.865837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.865837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.865837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.865837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.865837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.865837] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 673.934896] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.935498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.935498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.935498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.935498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.948515] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 673.955838] env[69350]: INFO networking_nsxv3.common.synchronization [req-07941d3a-67d0-4c3f-ba96-3d84b598ef13 req-0c482115-94f1-4d5b-ba7c-84d5232623c1 tempest-DeleteServersAdminTestJSON-666486710 tempest-DeleteServersAdminTestJSON-666486710-project-admin] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 673.956507] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 673.956898] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.956898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.957057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.957235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.959081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.959081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.959081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.959081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.959081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.959081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.042207] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 178642c9-c814-474a-bcc9-4bf40837f7b3 [ 674.042693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.042919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.043062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.043235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.043331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.043437] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:178642c9-c814-474a-bcc9-4bf40837f7b3 already deleted. [ 674.043521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-178642c9-c814-474a-bcc9-4bf40837f7b3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.124762] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.125020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.125157] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.125543] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.125735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.125936] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c86c212e-2e56-4561-a254-215ae27a7b86 not found, creating... [ 674.126208] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.126414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.126600] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.126814] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.126961] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.127545] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.127773] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.127894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.128293] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.128752] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.128752] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c86c212e-2e56-4561-a254-215ae27a7b86 is going to be created. [ 674.157806] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.158452] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.158633] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.158977] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.159293] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.159565] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.163443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.163642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.165065] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.168194] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b02a051-22c0-400f-ae3f-121acecbb02e with status ACTIVE [ 674.168194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.168194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.168194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.168194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.168194] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b02a051-22c0-400f-ae3f-121acecbb02e is going to be updated. [ 674.204041] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.204041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.204041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.204041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.204041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.204041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b02a051-22c0-400f-ae3f-121acecbb02e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.460386] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.460997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.460997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.462033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.462033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.462033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.462033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.462033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.462331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.462432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.463558] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be updated. [ 674.508330] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.508330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.508330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.508330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.508330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.519370] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 674.661042] env[69350]: INFO networking_nsxv3.common.synchronization [req-9ca1ef5d-0635-48d0-9123-d92567df9e55 req-91a6292a-5010-4d71-8e4c-6ea5ed8f2ea3 tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: ae32f0c2-8607-45ef-9b82-8d9fc67bf169 with Priority: HIGHEST for action security_group_rules [ 674.661675] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae32f0c2-8607-45ef-9b82-8d9fc67bf169 with Priority: HIGHEST for action security_group_rules [ 674.661968] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae32f0c2-8607-45ef-9b82-8d9fc67bf169 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.662297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae32f0c2-8607-45ef-9b82-8d9fc67bf169" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.662370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae32f0c2-8607-45ef-9b82-8d9fc67bf169" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.662725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae32f0c2-8607-45ef-9b82-8d9fc67bf169" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.662838] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae32f0c2-8607-45ef-9b82-8d9fc67bf169',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.675914] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.177686] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.178203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.178203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.178446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.178547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178650] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 is going to be created. [ 675.192694] env[69350]: INFO networking_nsxv3.common.synchronization [req-192e8966-58fc-4a28-acfd-7fec176ef7bf req-865c457c-9f20-43b6-a380-7a6a3f87bbbf service nova] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 675.194037] env[69350]: INFO networking_nsxv3.common.synchronization [req-192e8966-58fc-4a28-acfd-7fec176ef7bf req-865c457c-9f20-43b6-a380-7a6a3f87bbbf service nova] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 675.194037] env[69350]: INFO networking_nsxv3.common.synchronization [req-192e8966-58fc-4a28-acfd-7fec176ef7bf req-865c457c-9f20-43b6-a380-7a6a3f87bbbf service nova] Enqueued Resource ID: c86c212e-2e56-4561-a254-215ae27a7b86 with Priority: HIGHEST for action port [ 675.194037] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_rules [ 675.194037] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 675.194970] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86c212e-2e56-4561-a254-215ae27a7b86 with Priority: HIGHEST for action port [ 675.194970] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.194970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.195323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.195359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.195450] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.197565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.197691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.198338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.198338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.198338] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.198338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.199681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.199681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.199796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.199913] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.201025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c86c212e-2e56-4561-a254-215ae27a7b86 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.201151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.201203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.201409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.201487] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86c212e-2e56-4561-a254-215ae27a7b86',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.207929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.207929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.208241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.208350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.208384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.208486] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae32f0c2-8607-45ef-9b82-8d9fc67bf169 already deleted. [ 675.208568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae32f0c2-8607-45ef-9b82-8d9fc67bf169" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.237622] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.237622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.237806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.237904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.238090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.253388] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: UNINITIALIZED for 2s [ 675.481525] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.481525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.481525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.482229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.482229] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.706938] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c86c212e-2e56-4561-a254-215ae27a7b86 with status ACTIVE [ 675.707330] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.707538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.707610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.707828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.708405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.708405] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.708405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.708405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.708666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.708666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.709484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.709484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.709484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.709484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.709484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.709484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c86c212e-2e56-4561-a254-215ae27a7b86 is going to be updated. [ 675.710577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.710577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.710839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.737300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.737535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.737535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.737734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.737902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.738196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c86c212e-2e56-4561-a254-215ae27a7b86" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.839051] env[69350]: INFO networking_nsxv3.common.synchronization [None req-17799179-06ce-465f-b798-61732e71525f None None] Enqueued Resource ID: ffc5c3a4-f770-4304-a584-69dfca2e5408 with Priority: HIGHEST for action port [ 675.839878] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc5c3a4-f770-4304-a584-69dfca2e5408 with Priority: HIGHEST for action port [ 675.840762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc5c3a4-f770-4304-a584-69dfca2e5408 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.840943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc5c3a4-f770-4304-a584-69dfca2e5408" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.840943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc5c3a4-f770-4304-a584-69dfca2e5408" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.841662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc5c3a4-f770-4304-a584-69dfca2e5408" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.841917] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc5c3a4-f770-4304-a584-69dfca2e5408',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.966098] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 675.966451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.986162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.986345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.986400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.986706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.986889] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.986996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.987071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.987237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.987321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.987462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.987630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.987726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.987818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.988188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.988188] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.988536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.988536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.988536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.988642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.989486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.989486] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.213579] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.345543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffc5c3a4-f770-4304-a584-69dfca2e5408 [ 676.345543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.345543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffc5c3a4-f770-4304-a584-69dfca2e5408 already deleted. [ 676.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc5c3a4-f770-4304-a584-69dfca2e5408" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.492013] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce437c5a-9850-4106-9109-1794494f0682: rpc.has_security_group_logging(os_id): False [ 676.511286] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.511432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.511511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.511761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.511876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.512131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.512251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.512310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.512476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.512876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.512876] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.512876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.512876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.513070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.513070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.513316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.513409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.513459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.513678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.513678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.513798] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be created. [ 676.533593] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 676.533917] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 deletion is rescheduled due to dependency. [ 676.534124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.582787] env[69350]: INFO networking_nsxv3.common.synchronization [req-bee2033a-7741-45b7-83d2-30f5c16c1911 req-fd3c1161-b705-4bd8-a7ea-89be934dafbe tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 676.583360] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 676.585112] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.585295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.585295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.585657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.585844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.587096] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.587267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.587362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.587894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.587894] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.587894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.587894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.588162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.590065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.590065] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.607087] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 676.717337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.717729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.717921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.718289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.719287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.719504] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a is going to be created. [ 676.760936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.760936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.760936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.760936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.760936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.771317] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: UNINITIALIZED for 2s [ 677.043361] env[69350]: INFO networking_nsxv3.common.synchronization [req-f011ee1f-2051-4754-ad83-77c352db4961 req-337fd073-4024-464f-985b-9b3cf8a15593 tempest-ServerDiagnosticsNegativeTest-503426299 tempest-ServerDiagnosticsNegativeTest-503426299-project-member] Enqueued Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 677.043860] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGHEST for action security_group_members [ 677.044875] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.044875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.045031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.045307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.045451] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.045591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.045684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.045900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.046047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.046194] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.092493] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.166093] env[69350]: INFO networking_nsxv3.common.synchronization [None req-7cf60592-1458-4132-b2bf-a45f2dbd0e96 None None] Enqueued Resource ID: 292b35ef-8a88-475c-8301-8d1796f903a9 with Priority: HIGHEST for action port [ 677.166706] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 292b35ef-8a88-475c-8301-8d1796f903a9 with Priority: HIGHEST for action port [ 677.166959] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-292b35ef-8a88-475c-8301-8d1796f903a9 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.167652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-292b35ef-8a88-475c-8301-8d1796f903a9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.167652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-292b35ef-8a88-475c-8301-8d1796f903a9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.168618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-292b35ef-8a88-475c-8301-8d1796f903a9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.168763] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('292b35ef-8a88-475c-8301-8d1796f903a9',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.267184] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: SUCCESS [ 677.267387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.267555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.267998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.268306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.270681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.270681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.270681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.271119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.271119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.271119] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.549321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.549620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.549620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.551323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.551323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.551323] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 is going to be updated. [ 677.585550] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.585714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.585714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.586093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.586182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.596580] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.604111] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: IN_PROGRESS for 2s [ 677.652029] env[69350]: INFO networking_nsxv3.common.synchronization [req-1dcaa631-b1e4-4aa0-be72-1dd9cb3c4354 req-58459c98-3669-4394-9c77-42aa95060178 tempest-VolumesAssistedSnapshotsTest-1004854712 tempest-VolumesAssistedSnapshotsTest-1004854712-project-member] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 677.653039] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 677.653260] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.654111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.654111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.654111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.654111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.654447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.654527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.654748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.654916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.655084] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.671599] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 292b35ef-8a88-475c-8301-8d1796f903a9 [ 677.673199] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.673199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.673199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.674178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.674178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.674178] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:292b35ef-8a88-475c-8301-8d1796f903a9 already deleted. [ 677.674353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-292b35ef-8a88-475c-8301-8d1796f903a9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.775352] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.100619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.100847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.100925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.101241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.101359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.101485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 678.141627] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.141627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.141627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.141627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.141627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.151266] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 678.158559] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.158819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.158918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.159272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.159379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.159599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.159705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.159767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.159945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.160053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.160145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 already deleted. [ 678.160227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.279866] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc3154b0-663b-480d-966a-1fbdbe6d7897: rpc.has_security_group_logging(os_id): False [ 678.300868] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.301051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.301116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.301427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.301583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.301879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.301999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.302114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.302328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.302408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.302512] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 is going to be created. [ 678.371949] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.372209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.372290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.372604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.373369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.385781] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: IN_PROGRESS for 2s [ 678.621270] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 678.621270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.718554] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b170f0c8-9a72-42b6-9ef8-e000db4727d4 None None] Enqueued Resource ID: 2f70df3b-82f8-4486-8984-1a4081819707 with Priority: HIGHEST for action port [ 678.718554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f70df3b-82f8-4486-8984-1a4081819707 with Priority: HIGHEST for action port [ 678.719033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f70df3b-82f8-4486-8984-1a4081819707 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.719349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f70df3b-82f8-4486-8984-1a4081819707" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.719551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f70df3b-82f8-4486-8984-1a4081819707" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.720669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f70df3b-82f8-4486-8984-1a4081819707" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.721140] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f70df3b-82f8-4486-8984-1a4081819707',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.738539] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.738539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-209" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.738539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-209" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.738539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-209" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.738539] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.738539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.739319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.739738] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.740183] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.740795] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.741242] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.741520] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.742091] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.742492] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.742803] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.743244] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.767637] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.767637] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.767637] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.767637] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-209" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.767637] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.769260] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.769481] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.769916] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.770177] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e4ab21b-35cc-4073-99a7-f0f4fddd12ed',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.782898] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: SUCCESS [ 678.783548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.786573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.786573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.786573] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.170218] env[69350]: INFO networking_nsxv3.common.synchronization [req-3af78118-5bb3-4c67-bada-1b57f0332482 req-56db456e-9c14-472e-a6b1-0c2e74e7ef88 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 679.172784] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 679.173102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.173224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.224820] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f70df3b-82f8-4486-8984-1a4081819707 [ 679.225729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.225729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.225729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.225935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.225935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.225994] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f70df3b-82f8-4486-8984-1a4081819707 already deleted. [ 679.226320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f70df3b-82f8-4486-8984-1a4081819707" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.273775] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.274074] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.274269] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.274678] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.274861] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.275045] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed not found, creating... [ 679.275364] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.275496] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.275615] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.275861] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.275999] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.276434] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.276595] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.277254] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.277555] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.277843] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.277843] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed is going to be created. [ 679.289852] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.301597] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.301826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.302020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.302261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.302605] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.302876] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.615251] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 in Status: SUCCESS [ 679.615484] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 deletion is rescheduled due to dependency. [ 679.615555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.794388] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250212f8-b7b8-4a59-919a-a1ed1d003c9a: rpc.has_security_group_logging(os_id): False [ 679.816027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.816027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.816027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.816027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a is going to be created. [ 679.896800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.896800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.896800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.896800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.897040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.911972] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: IN_PROGRESS for 2s [ 680.127365] env[69350]: INFO networking_nsxv3.common.synchronization [req-050b8ff5-8eb9-4cfb-bed7-8adccf2ac0c5 req-05f0c352-05f9-4af4-a17a-47ff489da090 tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: 7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53 with Priority: HIGHEST for action security_group_rules [ 680.127992] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53 with Priority: HIGHEST for action security_group_rules [ 680.129458] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.130159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.130159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.130290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.130290] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.163631] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 680.165786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.166085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.166390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.166675] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.166829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.167776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.170221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.170390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.170564] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.403564] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: SUCCESS [ 680.403564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.446483] env[69350]: INFO networking_nsxv3.common.synchronization [req-1dcaa631-b1e4-4aa0-be72-1dd9cb3c4354 req-10016eba-a342-4d64-a783-79d2dd31a0da service nova] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 680.446483] env[69350]: INFO networking_nsxv3.common.synchronization [req-1dcaa631-b1e4-4aa0-be72-1dd9cb3c4354 req-10016eba-a342-4d64-a783-79d2dd31a0da service nova] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 680.446483] env[69350]: INFO networking_nsxv3.common.synchronization [req-1dcaa631-b1e4-4aa0-be72-1dd9cb3c4354 req-10016eba-a342-4d64-a783-79d2dd31a0da service nova] Enqueued Resource ID: 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed with Priority: HIGHEST for action port [ 680.446483] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_rules [ 680.446893] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 680.447673] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed with Priority: HIGHEST for action port [ 680.447673] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.447845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.447933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.448375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.448680] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.452977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.452977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.452977] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.452977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.452977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.453610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.453610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.453847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e4ab21b-35cc-4073-99a7-f0f4fddd12ed',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.656543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.658494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.658494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.658494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.658494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.658494] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53 already deleted. [ 680.658494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc442e7-4b7f-4d9f-b029-b6b5ea70dc53" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.676521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.676521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.676521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.676521] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 680.708579] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.708579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.708579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.708579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.708579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.723528] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 680.955713] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.957498] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.958700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.958700] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed with status ACTIVE [ 680.958700] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.958700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.958700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.959630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.959630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.959630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.959630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.959630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.959870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.959903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.960968] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.960968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.960968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.960968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.960968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.960968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e4ab21b-35cc-4073-99a7-f0f4fddd12ed is going to be updated. [ 680.989487] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.989681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.990019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.990108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.990255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.990511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e4ab21b-35cc-4073-99a7-f0f4fddd12ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.463979] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.804958] env[69350]: INFO networking_nsxv3.common.synchronization [None req-22ea0349-a959-40a8-8acc-7ed4b13b677f None None] Enqueued Resource ID: 4da3b38f-1ef8-45a6-acc2-bba89be55297 with Priority: HIGHEST for action port [ 681.804958] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da3b38f-1ef8-45a6-acc2-bba89be55297 with Priority: HIGHEST for action port [ 681.804958] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da3b38f-1ef8-45a6-acc2-bba89be55297 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.804958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da3b38f-1ef8-45a6-acc2-bba89be55297" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.804958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da3b38f-1ef8-45a6-acc2-bba89be55297" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.804958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da3b38f-1ef8-45a6-acc2-bba89be55297" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.804958] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da3b38f-1ef8-45a6-acc2-bba89be55297',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.927156] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: SUCCESS [ 681.927393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.971037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.971407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.971407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.971407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.971622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.971622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 is going to be created. [ 682.000134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.000334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.000461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.000584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.000745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.013570] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: UNINITIALIZED for 2s [ 682.306946] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4da3b38f-1ef8-45a6-acc2-bba89be55297 [ 682.306946] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.306946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.306946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.306946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.306946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.306946] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4da3b38f-1ef8-45a6-acc2-bba89be55297 already deleted. [ 682.306946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da3b38f-1ef8-45a6-acc2-bba89be55297" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.834590] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 682.834590] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 deletion is rescheduled due to dependency. [ 682.834590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.516407] env[69350]: INFO networking_nsxv3.common.synchronization [None req-e7afe4da-3010-453b-b02b-b1f50ffebc3b None None] Enqueued Resource ID: 3f045a19-e9f5-4d28-a18b-82a5a6b49d26 with Priority: HIGHEST for action port [ 683.516724] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f045a19-e9f5-4d28-a18b-82a5a6b49d26 with Priority: HIGHEST for action port [ 683.517238] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f045a19-e9f5-4d28-a18b-82a5a6b49d26 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.517413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f045a19-e9f5-4d28-a18b-82a5a6b49d26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.517465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f045a19-e9f5-4d28-a18b-82a5a6b49d26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.518735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f045a19-e9f5-4d28-a18b-82a5a6b49d26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.518735] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f045a19-e9f5-4d28-a18b-82a5a6b49d26',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.994356] env[69350]: INFO networking_nsxv3.common.synchronization [None req-854cb38a-d167-4ac2-9e10-78bc29e58de0 None None] Enqueued Resource ID: c9afed53-49ce-417b-b1d4-f380d322a899 with Priority: HIGHEST for action port [ 683.994356] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9afed53-49ce-417b-b1d4-f380d322a899 with Priority: HIGHEST for action port [ 683.994356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9afed53-49ce-417b-b1d4-f380d322a899 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.994356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9afed53-49ce-417b-b1d4-f380d322a899" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.994356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9afed53-49ce-417b-b1d4-f380d322a899" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.996154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9afed53-49ce-417b-b1d4-f380d322a899" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.997705] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9afed53-49ce-417b-b1d4-f380d322a899',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.020234] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f045a19-e9f5-4d28-a18b-82a5a6b49d26 [ 684.020465] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.020625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.020708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.020923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.021029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.021187] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f045a19-e9f5-4d28-a18b-82a5a6b49d26 already deleted. [ 684.021248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f045a19-e9f5-4d28-a18b-82a5a6b49d26" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.033954] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: SUCCESS [ 684.034211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.034741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.034977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.035502] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.035502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.035502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.035502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.035713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.035713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.035830] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.249687] env[69350]: INFO networking_nsxv3.common.synchronization [req-ce8e05b6-863e-4ceb-a5eb-bcd5f630841b req-3cf8a0ea-e186-488b-add3-7088615acaf7 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 684.250285] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 684.250634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.250763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.250835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.252489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.252489] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.252489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.252761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.252761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.252761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.252897] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.498710] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9afed53-49ce-417b-b1d4-f380d322a899 [ 684.499291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.499291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.499291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.500582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.500920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.500920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9afed53-49ce-417b-b1d4-f380d322a899 already deleted. [ 684.501021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9afed53-49ce-417b-b1d4-f380d322a899" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.537575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.755125] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.755269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.755269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.755537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.755645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.756173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.756768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.757198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.757586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.757904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.757904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b already deleted. [ 684.758035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092: rpc.has_security_group_logging(os_id): False [ 685.063052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.063236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.063296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.063540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.063606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.063855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.063935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.063995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.064140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.064218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.064305] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 is going to be created. [ 685.146931] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.147221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.147221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.147889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.161535] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: IN_PROGRESS for 2s [ 685.337209] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.337209] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.339029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.342327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.342327] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.342327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.342327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.342327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.342327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.342327] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.342327] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.342327] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.342327] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.342327] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.342327] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.342327] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.364573] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.364770] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.364906] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.365112] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.365441] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9f80b973-7124-44d9-acbe-0dff3054e787 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.365611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.365726] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.366052] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.366185] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f80b973-7124-44d9-acbe-0dff3054e787',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.817398] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3f8f94c7-5ed5-4732-8e10-df3130c5ffcf None None] Enqueued Resource ID: afab372a-309d-40fd-b79f-f35a7dbf3fab with Priority: HIGHEST for action port [ 685.817703] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afab372a-309d-40fd-b79f-f35a7dbf3fab with Priority: HIGHEST for action port [ 685.818376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-afab372a-309d-40fd-b79f-f35a7dbf3fab taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.818520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afab372a-309d-40fd-b79f-f35a7dbf3fab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.818588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afab372a-309d-40fd-b79f-f35a7dbf3fab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.818873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afab372a-309d-40fd-b79f-f35a7dbf3fab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.818960] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afab372a-309d-40fd-b79f-f35a7dbf3fab',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.869961] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.869961] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.870163] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.870315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.870520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.870780] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 9f80b973-7124-44d9-acbe-0dff3054e787 not found, creating... [ 685.871399] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.871399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.871399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.871731] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.872412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.873456] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.873558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.873718] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.873979] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.874139] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.874743] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9f80b973-7124-44d9-acbe-0dff3054e787 is going to be created. [ 685.899178] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.899426] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.899743] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.899870] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.900084] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.900325] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.058572] env[69350]: INFO networking_nsxv3.common.synchronization [None req-7482f373-ab54-4a6f-9661-dcfa491676c6 None None] Enqueued Resource ID: 60e32b6b-d649-44bb-ae31-4015cfb0ce9d with Priority: HIGHEST for action port [ 686.058572] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e32b6b-d649-44bb-ae31-4015cfb0ce9d with Priority: HIGHEST for action port [ 686.058572] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-60e32b6b-d649-44bb-ae31-4015cfb0ce9d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.058572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60e32b6b-d649-44bb-ae31-4015cfb0ce9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.058572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60e32b6b-d649-44bb-ae31-4015cfb0ce9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.058572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60e32b6b-d649-44bb-ae31-4015cfb0ce9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.058572] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60e32b6b-d649-44bb-ae31-4015cfb0ce9d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.327095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afab372a-309d-40fd-b79f-f35a7dbf3fab [ 686.327895] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.327895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.327895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.328089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.328130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.328260] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afab372a-309d-40fd-b79f-f35a7dbf3fab already deleted. [ 686.328442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afab372a-309d-40fd-b79f-f35a7dbf3fab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.358080] env[69350]: INFO networking_nsxv3.common.synchronization [req-db9119a6-470f-4a7a-a853-2433cbcb7a43 req-896a1e37-2212-4509-ba02-c4f2c58efc5f tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 686.358080] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 686.359595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.360156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.360323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.360780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.361014] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6c1fabe-4fd7-4151-aceb-2d53875eac7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.561356] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60e32b6b-d649-44bb-ae31-4015cfb0ce9d [ 686.561356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.561356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.561356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.561356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.561356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.561356] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60e32b6b-d649-44bb-ae31-4015cfb0ce9d already deleted. [ 686.561356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60e32b6b-d649-44bb-ae31-4015cfb0ce9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.883738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.884066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.884066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.884177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.884276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.884371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f already deleted. [ 686.884688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.987951] env[69350]: INFO networking_nsxv3.common.synchronization [req-ddbe9ab2-818e-4f3b-87ca-bcb0afbe406e req-768c15cc-05ea-48d8-825b-5c86b6f5f889 tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 686.989021] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 686.989339] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.989479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.989548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.989807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.989962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.991841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.991896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.992548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.992548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.992548] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.177303] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: SUCCESS [ 687.177859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.496605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.496605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.496605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a already deleted. [ 687.496605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.019562] env[69350]: INFO networking_nsxv3.common.synchronization [req-ce8e05b6-863e-4ceb-a5eb-bcd5f630841b req-38c95a10-d879-4676-b812-f5f160b55267 service nova] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 688.019562] env[69350]: INFO networking_nsxv3.common.synchronization [req-ce8e05b6-863e-4ceb-a5eb-bcd5f630841b req-38c95a10-d879-4676-b812-f5f160b55267 service nova] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 688.020584] env[69350]: INFO networking_nsxv3.common.synchronization [req-ce8e05b6-863e-4ceb-a5eb-bcd5f630841b req-38c95a10-d879-4676-b812-f5f160b55267 service nova] Enqueued Resource ID: 9f80b973-7124-44d9-acbe-0dff3054e787 with Priority: HIGHEST for action port [ 688.021201] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 688.024019] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 688.024019] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f80b973-7124-44d9-acbe-0dff3054e787 with Priority: HIGHEST for action port [ 688.024019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.024019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.024019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.024019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.024019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.024019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.024499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.024499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.024499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.024499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.024654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.024654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.024850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.024889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.025038] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.028155] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f80b973-7124-44d9-acbe-0dff3054e787 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.028155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.028478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.028478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.028478] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f80b973-7124-44d9-acbe-0dff3054e787',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.206413] env[69350]: INFO networking_nsxv3.common.synchronization [req-8d1c031a-7711-4236-a65e-89258b7ac793 req-61093e38-0bb8-4a2f-8b58-884951b114b9 tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 688.206413] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 688.206413] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.206413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.206413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.206413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.206413] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6c1fabe-4fd7-4151-aceb-2d53875eac7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.425112] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.425329] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.425455] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.425791] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.428190] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.428190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.428190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.428372] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.428520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.428786] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.428916] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.429042] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.429156] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.429272] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.429377] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.429518] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.451181] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.451181] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.451181] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.451181] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.451181] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.451181] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.451708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.451708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.451810] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61161ecf-e1b8-4dd3-9cd7-3da33f82ec55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.530819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.531058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.531291] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.535433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f80b973-7124-44d9-acbe-0dff3054e787 with status ACTIVE [ 688.535567] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.535690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.535750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.535950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.536059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.536787] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.536787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.536787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.536787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.536787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.536787] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.537284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.537284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.537284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.537284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.537284] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f80b973-7124-44d9-acbe-0dff3054e787 is going to be updated. [ 688.563802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.564232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.564232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.564232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.564389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.564516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.729115] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.729115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.729115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.729115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.729115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.729115] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f already deleted. [ 688.729115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.955301] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.955839] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.955839] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.956333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.956520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.956665] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 not found, creating... [ 688.956969] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.957130] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.957265] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.957574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.957646] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.957953] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.959319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.959518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.959670] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.959839] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.960036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 is going to be created. [ 688.984403] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.984761] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.984875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.985180] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.985648] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.985736] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.036678] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.444979] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d94a8843-0579-4f60-aa60-00511d9da6ba None None] Enqueued Resource ID: d60749a3-1342-48ca-b7a3-106728ba7193 with Priority: HIGHEST for action port [ 689.444979] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d60749a3-1342-48ca-b7a3-106728ba7193 with Priority: HIGHEST for action port [ 689.445551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d60749a3-1342-48ca-b7a3-106728ba7193 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.445551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d60749a3-1342-48ca-b7a3-106728ba7193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.445551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d60749a3-1342-48ca-b7a3-106728ba7193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.445551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d60749a3-1342-48ca-b7a3-106728ba7193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.445551] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60749a3-1342-48ca-b7a3-106728ba7193',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.498026] env[69350]: INFO networking_nsxv3.common.synchronization [req-b88b6cc3-12aa-41aa-ae49-4d4874db87b4 req-0eced315-47e8-4679-80f7-7c185e57494c tempest-AttachInterfacesV270Test-11186757 tempest-AttachInterfacesV270Test-11186757-project-member] Enqueued Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 689.498026] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 689.498026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.498026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.498026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.498792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.499120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.499425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.501495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.501495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.501495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.501495] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.542050] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.545244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.545244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.545244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.545244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.545244] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be created. [ 689.570424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.570424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.570424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.570689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.570689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.581899] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: UNINITIALIZED for 2s [ 689.952526] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d60749a3-1342-48ca-b7a3-106728ba7193 [ 689.952526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.952526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.952526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.952526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.952526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.952526] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d60749a3-1342-48ca-b7a3-106728ba7193 already deleted. [ 689.952526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d60749a3-1342-48ca-b7a3-106728ba7193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.004185] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.004185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.004185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.004185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.004185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.005399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.005399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.005399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.008522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.008522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.008522] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 already deleted. [ 690.008522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.141920] env[69350]: INFO networking_nsxv3.common.synchronization [None req-487ba340-1ec6-49e5-bd79-64dfeefe664c None None] Enqueued Resource ID: b77c3315-ea3b-4bce-a1b8-58ebc32574b5 with Priority: HIGHEST for action port [ 690.142223] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77c3315-ea3b-4bce-a1b8-58ebc32574b5 with Priority: HIGHEST for action port [ 690.142775] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b77c3315-ea3b-4bce-a1b8-58ebc32574b5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.142898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b77c3315-ea3b-4bce-a1b8-58ebc32574b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.142959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b77c3315-ea3b-4bce-a1b8-58ebc32574b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.144146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b77c3315-ea3b-4bce-a1b8-58ebc32574b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.144258] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b77c3315-ea3b-4bce-a1b8-58ebc32574b5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.646531] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b77c3315-ea3b-4bce-a1b8-58ebc32574b5 [ 690.646531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.646666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.646771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.647045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.647136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.647227] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b77c3315-ea3b-4bce-a1b8-58ebc32574b5 already deleted. [ 690.647303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b77c3315-ea3b-4bce-a1b8-58ebc32574b5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.716315] env[69350]: INFO networking_nsxv3.common.synchronization [req-ddbe9ab2-818e-4f3b-87ca-bcb0afbe406e req-7dd715f6-415a-429a-8d99-aa36ba1cab10 service nova] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 690.716521] env[69350]: INFO networking_nsxv3.common.synchronization [req-ddbe9ab2-818e-4f3b-87ca-bcb0afbe406e req-7dd715f6-415a-429a-8d99-aa36ba1cab10 service nova] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 690.716618] env[69350]: INFO networking_nsxv3.common.synchronization [req-ddbe9ab2-818e-4f3b-87ca-bcb0afbe406e req-7dd715f6-415a-429a-8d99-aa36ba1cab10 service nova] Enqueued Resource ID: 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 with Priority: HIGHEST for action port [ 690.718567] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 690.718721] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 690.718822] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 with Priority: HIGHEST for action port [ 690.719168] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.719286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.719357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.719566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.719662] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.720920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.721000] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.721000] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.721475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.721684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.721776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.721838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.722535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.722707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.722761] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.724060] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.724525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.724673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.724868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.724940] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61161ecf-e1b8-4dd3-9cd7-3da33f82ec55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.795171] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.795621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-487" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.795621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-487" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.797174] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-487" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.797174] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.797174] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.797174] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.797534] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.797652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.798067] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.798141] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.798245] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.800354] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.800517] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.800691] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.800796] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.823615] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.823615] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.823774] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.827352] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-487" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.827691] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9198b768-fdbb-4c38-b409-6543d19a7dca taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.827918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.828088] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.832372] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.832372] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9198b768-fdbb-4c38-b409-6543d19a7dca',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.946862] env[69350]: INFO networking_nsxv3.common.synchronization [req-9abb9251-4710-4dd5-8973-7acfcefff58b req-34282024-749f-4a6d-9081-ac866eb365a4 tempest-SecurityGroupRulesTestJSON-457391572 tempest-SecurityGroupRulesTestJSON-457391572-project-member] Enqueued Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 690.949080] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f with Priority: HIGHEST for action security_group_rules [ 690.949197] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.949265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.949370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.949539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.949618] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6c1fabe-4fd7-4151-aceb-2d53875eac7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.229909] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.229909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.229909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.241807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 with status ACTIVE [ 691.241807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.241807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.241807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.241807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.241807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61161ecf-e1b8-4dd3-9cd7-3da33f82ec55 is going to be updated. [ 691.279622] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.279622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.279622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.279900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.279900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.279967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61161ecf-e1b8-4dd3-9cd7-3da33f82ec55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.337488] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.337488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.337698] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.337858] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.338059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.338166] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 9198b768-fdbb-4c38-b409-6543d19a7dca not found, creating... [ 691.338466] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.338619] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.338952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.338952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.339095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.339377] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.339582] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.339745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.343467] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.343932] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.343932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9198b768-fdbb-4c38-b409-6543d19a7dca is going to be created. [ 691.385997] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.385997] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.385997] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.385997] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.386294] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.386486] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.474860] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.474860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.474860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.474860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.474860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.474860] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6c1fabe-4fd7-4151-aceb-2d53875eac7f already deleted. [ 691.474860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6c1fabe-4fd7-4151-aceb-2d53875eac7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.593711] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: SUCCESS [ 691.593711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.593884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.594113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.594177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.594313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.594375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.594540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.594643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.594729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.594826] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.737160] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.097516] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.243106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.243106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.243106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.244167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.244167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.244167] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be created. [ 692.268166] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.268166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.268166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.268544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.268892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.280964] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: UNINITIALIZED for 2s [ 692.354556] env[69350]: INFO networking_nsxv3.common.synchronization [None req-de60217a-7e90-4db3-87a6-c1071856973e None None] Enqueued Resource ID: 2d363309-df11-43bb-a234-a39a0c55fd94 with Priority: HIGHEST for action port [ 692.355298] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d363309-df11-43bb-a234-a39a0c55fd94 with Priority: HIGHEST for action port [ 692.357202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d363309-df11-43bb-a234-a39a0c55fd94 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.357474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d363309-df11-43bb-a234-a39a0c55fd94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.357474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d363309-df11-43bb-a234-a39a0c55fd94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.357982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d363309-df11-43bb-a234-a39a0c55fd94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.357982] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d363309-df11-43bb-a234-a39a0c55fd94',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.438069] env[69350]: INFO networking_nsxv3.common.synchronization [req-b88b6cc3-12aa-41aa-ae49-4d4874db87b4 req-139ff409-5b4d-4484-9616-8a7e9b96ebed service nova] Enqueued Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_rules [ 692.438497] env[69350]: INFO networking_nsxv3.common.synchronization [req-b88b6cc3-12aa-41aa-ae49-4d4874db87b4 req-139ff409-5b4d-4484-9616-8a7e9b96ebed service nova] Enqueued Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 692.438497] env[69350]: INFO networking_nsxv3.common.synchronization [req-b88b6cc3-12aa-41aa-ae49-4d4874db87b4 req-139ff409-5b4d-4484-9616-8a7e9b96ebed service nova] Enqueued Resource ID: 9198b768-fdbb-4c38-b409-6543d19a7dca with Priority: HIGHEST for action port [ 692.438675] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_rules [ 692.438802] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 692.438898] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9198b768-fdbb-4c38-b409-6543d19a7dca with Priority: HIGHEST for action port [ 692.439499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.439644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.439708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.439973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.440132] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.441456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.441574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.441642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.441821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.441972] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.442080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.442134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.442282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.442367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.442458] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.443465] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9198b768-fdbb-4c38-b409-6543d19a7dca taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.443574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.443635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.443820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.443898] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9198b768-fdbb-4c38-b409-6543d19a7dca',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.601965] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9657ac2-98f3-4bb3-988b-9e7555afd46b: rpc.has_security_group_logging(os_id): False [ 692.621316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.621316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.621316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.621554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.621554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.621753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.621854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.621929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.622087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.622167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.622258] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be created. [ 692.691446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.692049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.692049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.692049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.692221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.704609] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: IN_PROGRESS for 2s [ 692.863885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d363309-df11-43bb-a234-a39a0c55fd94 [ 692.864217] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.864400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.864473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.864704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.864835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.864936] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d363309-df11-43bb-a234-a39a0c55fd94 already deleted. [ 692.865034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d363309-df11-43bb-a234-a39a0c55fd94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.946136] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.947437] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.947519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.947624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9198b768-fdbb-4c38-b409-6543d19a7dca with status ACTIVE [ 692.947778] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.947884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.947943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.948197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.948275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.948524] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.948665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.948743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.948908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.948990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.953711] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.953711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.953711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.953711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.953711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.953711] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9198b768-fdbb-4c38-b409-6543d19a7dca is going to be updated. [ 692.985837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.985837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.985837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.985837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.985837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.986233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9198b768-fdbb-4c38-b409-6543d19a7dca" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.181460] env[69350]: INFO networking_nsxv3.common.synchronization [None req-dec8830d-02e6-476d-917f-ead8689ff18c tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 693.182010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 693.182347] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.182472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.182542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.183042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.183042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.314767] env[69350]: INFO networking_nsxv3.common.synchronization [None req-189c75c9-83c9-4d33-b426-8e8a356164ce tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 693.315166] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 693.315433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.317377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.457717] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.705332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.705503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.705547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.705760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.705838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.705937] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 already deleted. [ 693.706025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.706184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.706533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.706621] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.830441] env[69350]: INFO networking_nsxv3.common.synchronization [req-83c0957b-abec-4166-bf7c-77c1544d4702 req-7d7beefe-ad1c-43ea-9573-9cdf3c460969 tempest-ServersTestJSON-666805160 tempest-ServersTestJSON-666805160-project-member] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 693.830441] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 693.830441] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.830716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.830716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.830900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.831138] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.831278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.831366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.831555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.831670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.831786] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.959820] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.959820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.960014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.960128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.960228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.960331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 is going to be created. [ 693.997401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.997550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.997652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.998190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.998190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.009400] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: UNINITIALIZED for 2s [ 694.234366] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.234366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.234366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.234366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.234366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.234366] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 already deleted. [ 694.234366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292295] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.293638] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.294187] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.333843] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.334121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.334121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.334314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.334403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.337159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.337159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.337159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.337159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.337159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.337159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 already deleted. [ 694.337159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.572739] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.573179] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.573179] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.574341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.574341] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.574341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.574341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.575745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.575920] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.577811] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.577811] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.577811] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.577811] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.578303] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.578303] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.578303] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.598218] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.598218] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.598218] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.598218] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598218] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.598535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598933] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598933] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ade96f-3541-42c9-9f06-ec6e60dc2e9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.736187] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: SUCCESS [ 694.736187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796367] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.101029] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.101935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.101935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.101935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.101935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.102214] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 24ade96f-3541-42c9-9f06-ec6e60dc2e9a not found, creating... [ 695.102268] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.102410] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.102529] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.102745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.102882] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.103696] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.103696] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.103833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.103949] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.104760] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 24ade96f-3541-42c9-9f06-ec6e60dc2e9a is going to be created. [ 695.129414] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.129630] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.129769] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.130040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.130276] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.130519] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.299248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518254d1-d440-4d15-b32d-8975c834377a: rpc.has_security_group_logging(os_id): False [ 695.321738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.322037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.322128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.322369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.322488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.322762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.322872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.322950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.323121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.323201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.323292] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be created. [ 695.400879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.400879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.400879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.400879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.400879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.412959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 696.021077] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: SUCCESS [ 696.021380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.021595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.021862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.022119] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.022291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.022391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.022602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.022728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.022853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.022997] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.526070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.526496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.526496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.526496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.526644] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.526765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.526822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.526987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.527152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.527192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.527354] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.527448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.527511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.527674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.527824] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.527938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.528015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.528151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.528228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.528314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.528438] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.545440] env[69350]: INFO networking_nsxv3.common.synchronization [req-83c0957b-abec-4166-bf7c-77c1544d4702 req-06075c3a-4d7c-403d-84ca-0b052fdf4ef6 service nova] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 696.545665] env[69350]: INFO networking_nsxv3.common.synchronization [req-83c0957b-abec-4166-bf7c-77c1544d4702 req-06075c3a-4d7c-403d-84ca-0b052fdf4ef6 service nova] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 696.545837] env[69350]: INFO networking_nsxv3.common.synchronization [req-83c0957b-abec-4166-bf7c-77c1544d4702 req-06075c3a-4d7c-403d-84ca-0b052fdf4ef6 service nova] Enqueued Resource ID: 24ade96f-3541-42c9-9f06-ec6e60dc2e9a with Priority: HIGHEST for action port [ 696.547424] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_rules [ 696.547424] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 696.547424] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ade96f-3541-42c9-9f06-ec6e60dc2e9a with Priority: HIGHEST for action port [ 696.547424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.547620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.547620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.547804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.547911] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.548844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.548949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.549043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.549226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.549395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.549518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.549585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.549740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.549829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.549922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.550995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.551690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.551768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.551940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.552053] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ade96f-3541-42c9-9f06-ec6e60dc2e9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.026200] env[69350]: INFO networking_nsxv3.common.synchronization [req-388eb3c6-6f26-4492-9dcc-2f845af158e4 req-8383b390-d84d-49d7-b4b2-9410bd0c9eb4 tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 697.027643] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 697.028132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.028293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.028455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.028780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.028983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.029101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.029227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.029473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.029579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.029681] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.031988] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7d6c991-1741-482f-bd6f-0a1e7794c335: rpc.has_security_group_logging(os_id): False [ 697.053354] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.054729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.055420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.055420] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24ade96f-3541-42c9-9f06-ec6e60dc2e9a with status ACTIVE [ 697.055522] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.055670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.055670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.055946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.056049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.056247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.056356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.056726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.056726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.056726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.056905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.057031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.057395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.057395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.057395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.057612] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24ade96f-3541-42c9-9f06-ec6e60dc2e9a is going to be updated. [ 697.063034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.063034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.063034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.063797] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.063797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.063797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.063797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.063797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.063797] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.064045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.064045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.064110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.064208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.064332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 is going to be created. [ 697.087944] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.087944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.087944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.087944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.087944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.087944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24ade96f-3541-42c9-9f06-ec6e60dc2e9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.131446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.131660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.131660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.131884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.132224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.150137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: IN_PROGRESS for 2s [ 697.425238] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 697.426626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.535958] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.536342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.536342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.536539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.536680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.536932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.537926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.537926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.537926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.537926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.537926] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 already deleted. [ 697.537926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.559435] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.060031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.060031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.060031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.060031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.060031] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 is going to be created. [ 698.085547] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.085711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.085782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.089306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.089601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.108597] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: UNINITIALIZED for 2s [ 698.471728] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.471927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.472069] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.472338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.472592] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.472741] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.472967] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.473487] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.473487] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.473598] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.473678] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.473767] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.473868] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.473969] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.474112] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.474202] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.494434] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.494750] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.494750] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.494971] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.495573] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-d171bd20-a981-427d-8a08-5abf6dc65853 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.495573] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.495573] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.495945] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.496115] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d171bd20-a981-427d-8a08-5abf6dc65853',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.998806] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.999275] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.002313] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.002657] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.002822] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.002994] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port d171bd20-a981-427d-8a08-5abf6dc65853 not found, creating... [ 699.003308] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.004034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.004034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.004034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.004034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.004609] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.004804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.004964] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.005233] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.005418] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.005698] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: d171bd20-a981-427d-8a08-5abf6dc65853 is going to be created. [ 699.037226] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.037226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.037226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.037226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.037226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.037226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.166911] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: SUCCESS [ 699.167304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.121332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: SUCCESS [ 700.121332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.121332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.121332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.121332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.121332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.121332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.121887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.121887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.121887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.121887] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.528243] env[69350]: INFO networking_nsxv3.common.synchronization [req-388eb3c6-6f26-4492-9dcc-2f845af158e4 req-5f6b9a9f-0b11-4726-b2f9-b6cedf71912d service nova] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_rules [ 700.528470] env[69350]: INFO networking_nsxv3.common.synchronization [req-388eb3c6-6f26-4492-9dcc-2f845af158e4 req-5f6b9a9f-0b11-4726-b2f9-b6cedf71912d service nova] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 700.528621] env[69350]: INFO networking_nsxv3.common.synchronization [req-388eb3c6-6f26-4492-9dcc-2f845af158e4 req-5f6b9a9f-0b11-4726-b2f9-b6cedf71912d service nova] Enqueued Resource ID: d171bd20-a981-427d-8a08-5abf6dc65853 with Priority: HIGHEST for action port [ 700.528861] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_rules [ 700.528990] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 700.529157] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d171bd20-a981-427d-8a08-5abf6dc65853 with Priority: HIGHEST for action port [ 700.529700] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.529819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.529889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.530455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.530455] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.531390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.531390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.531898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.531997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.532238] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.532238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.532371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.532751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.532751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.532751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.533578] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d171bd20-a981-427d-8a08-5abf6dc65853 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.533578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.533578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.534112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.534112] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d171bd20-a981-427d-8a08-5abf6dc65853',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.625771] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.036614] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d171bd20-a981-427d-8a08-5abf6dc65853 with status ACTIVE [ 701.036702] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.037995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.037995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.038921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.039058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.039308] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.039449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.039537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.039746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.039862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.039990] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d171bd20-a981-427d-8a08-5abf6dc65853 is going to be updated. [ 701.041908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.042121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.042334] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.068722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.068722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.068722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.068722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.068722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.068722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d171bd20-a981-427d-8a08-5abf6dc65853" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.129618] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc83992c-258f-4908-a0ee-f421d5b307a0: rpc.has_security_group_logging(os_id): False [ 701.160696] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.160860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.161979] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.161979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.164402] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 is going to be created. [ 701.276993] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.276993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.276993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.276993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.276993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.291020] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: IN_PROGRESS for 2s [ 701.545693] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.052288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.052509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.052588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.052834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.052969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.053209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be created. [ 702.090427] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.090550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.090616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.090925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.091145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.105467] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: UNINITIALIZED for 2s [ 703.017227] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0c30c5b3-ff0d-4196-9029-cd1b1902e9a2 None None] Enqueued Resource ID: e423a81f-39ad-4645-944b-a5c108a9a04c with Priority: HIGHEST for action port [ 703.017227] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e423a81f-39ad-4645-944b-a5c108a9a04c with Priority: HIGHEST for action port [ 703.017227] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e423a81f-39ad-4645-944b-a5c108a9a04c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.017227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e423a81f-39ad-4645-944b-a5c108a9a04c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.017227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e423a81f-39ad-4645-944b-a5c108a9a04c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.017227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e423a81f-39ad-4645-944b-a5c108a9a04c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.017227] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e423a81f-39ad-4645-944b-a5c108a9a04c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.306960] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: SUCCESS [ 703.307222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.520667] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e423a81f-39ad-4645-944b-a5c108a9a04c [ 703.521042] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.521271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.521367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.521628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.521728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.521824] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e423a81f-39ad-4645-944b-a5c108a9a04c already deleted. [ 703.521907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e423a81f-39ad-4645-944b-a5c108a9a04c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.764753] env[69350]: INFO networking_nsxv3.common.synchronization [None req-38069658-baba-468a-ae36-39ce08e7360a None None] Enqueued Resource ID: 84f01c63-0419-4a47-b15b-e92c6aa55e21 with Priority: HIGHEST for action port [ 703.764875] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f01c63-0419-4a47-b15b-e92c6aa55e21 with Priority: HIGHEST for action port [ 703.767039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-84f01c63-0419-4a47-b15b-e92c6aa55e21 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.767039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84f01c63-0419-4a47-b15b-e92c6aa55e21" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.767039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84f01c63-0419-4a47-b15b-e92c6aa55e21" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.767039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84f01c63-0419-4a47-b15b-e92c6aa55e21" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.767039] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f01c63-0419-4a47-b15b-e92c6aa55e21',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.118697] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: UNINITIALIZED for 4s [ 704.270145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84f01c63-0419-4a47-b15b-e92c6aa55e21 [ 704.270232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.270326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.270389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.271038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.271038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.271038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84f01c63-0419-4a47-b15b-e92c6aa55e21 already deleted. [ 704.271038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84f01c63-0419-4a47-b15b-e92c6aa55e21" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.265578] env[69350]: INFO networking_nsxv3.common.synchronization [None req-ec967a05-1fe2-48e6-9976-fed64264171c None None] Enqueued Resource ID: 77a1c891-0441-4bc0-b763-9a18bffe41cf with Priority: HIGHEST for action port [ 705.265830] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77a1c891-0441-4bc0-b763-9a18bffe41cf with Priority: HIGHEST for action port [ 705.266546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-77a1c891-0441-4bc0-b763-9a18bffe41cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.267338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77a1c891-0441-4bc0-b763-9a18bffe41cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.267338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77a1c891-0441-4bc0-b763-9a18bffe41cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.267338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77a1c891-0441-4bc0-b763-9a18bffe41cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.267338] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77a1c891-0441-4bc0-b763-9a18bffe41cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.509906] env[69350]: INFO networking_nsxv3.common.synchronization [None req-66e9ea64-4ffe-419c-bc46-7d45cf38a144 None None] Enqueued Resource ID: ea460bcb-7a03-402a-8496-11c71fe92f2f with Priority: HIGHEST for action port [ 705.509906] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea460bcb-7a03-402a-8496-11c71fe92f2f with Priority: HIGHEST for action port [ 705.510353] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea460bcb-7a03-402a-8496-11c71fe92f2f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.510482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea460bcb-7a03-402a-8496-11c71fe92f2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.510547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea460bcb-7a03-402a-8496-11c71fe92f2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.510805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea460bcb-7a03-402a-8496-11c71fe92f2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.510886] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea460bcb-7a03-402a-8496-11c71fe92f2f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.770280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77a1c891-0441-4bc0-b763-9a18bffe41cf [ 705.770620] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.770812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.770890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.771200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.771328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.771456] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77a1c891-0441-4bc0-b763-9a18bffe41cf already deleted. [ 705.771576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77a1c891-0441-4bc0-b763-9a18bffe41cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.016018] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea460bcb-7a03-402a-8496-11c71fe92f2f [ 706.016018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.016018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.016018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.016018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.016018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.016018] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea460bcb-7a03-402a-8496-11c71fe92f2f already deleted. [ 706.016018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea460bcb-7a03-402a-8496-11c71fe92f2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136061] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 706.136292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.137074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.137158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.137342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.137436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137617] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.231695] env[69350]: INFO networking_nsxv3.common.synchronization [None req-52828da0-b659-47ac-9fcc-a3f80974c0b3 None None] Enqueued Resource ID: 2d383ccb-f182-4793-b706-05b6a86bd0d2 with Priority: HIGHEST for action port [ 706.231958] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d383ccb-f182-4793-b706-05b6a86bd0d2 with Priority: HIGHEST for action port [ 706.232982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d383ccb-f182-4793-b706-05b6a86bd0d2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.234331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d383ccb-f182-4793-b706-05b6a86bd0d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.234378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d383ccb-f182-4793-b706-05b6a86bd0d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.234629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d383ccb-f182-4793-b706-05b6a86bd0d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.234714] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d383ccb-f182-4793-b706-05b6a86bd0d2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.297325] env[69350]: INFO networking_nsxv3.common.synchronization [req-05b2dab6-aa13-4a27-9ddf-ac94dfdfa621 req-19bd9948-b0f6-4a35-86c6-d0b05039b6c0 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 706.300892] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 706.300892] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.300892] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.300892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.300892] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.642314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.642314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.642314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.642314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.645082] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.645082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.645082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.645082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.645082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.645082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.645082] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.737611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d383ccb-f182-4793-b706-05b6a86bd0d2 [ 706.737611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.737611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.737611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.737611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.737611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.737611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d383ccb-f182-4793-b706-05b6a86bd0d2 already deleted. [ 706.737946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d383ccb-f182-4793-b706-05b6a86bd0d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.801309] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.801486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.801544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.801788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.801872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.802073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.802152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.802236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.803945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.804091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.804291] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec already deleted. [ 706.804358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.916983] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.918165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.918165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.918389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.918537] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.918725] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.918846] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.919092] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.919698] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.919698] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.919698] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.919698] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.919936] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.919936] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.920755] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.920755] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.942385] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.942385] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.942800] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.943156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.943344] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.943553] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.944115] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.944115] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.944259] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d7c1a5-a050-4b34-bd94-c6265cf85efb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.148195] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ab8bb33-410e-45b2-83bb-f1219bc73c45: rpc.has_security_group_logging(os_id): False [ 707.171847] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.171847] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.171847] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.171847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.172507] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.172507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.172507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.173232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.173477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.173688] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be created. [ 707.252021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.252673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.252673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.252673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.252673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.267276] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 707.447689] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.448089] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.448547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.449208] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.450907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.450907] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port f7d7c1a5-a050-4b34-bd94-c6265cf85efb not found, creating... [ 707.450907] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.450907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.450907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.450907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.451319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.451716] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.454058] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.454058] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.454058] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.454058] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.454058] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb is going to be created. [ 707.478110] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.478369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.478600] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.478900] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.479148] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.479388] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.853946] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c29ce0c4-9031-4fb9-b33e-0eaab98fc6a8 None None] Enqueued Resource ID: 34f77179-d62b-4bdc-ad25-0f2afa99ba20 with Priority: HIGHEST for action port [ 707.854294] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34f77179-d62b-4bdc-ad25-0f2afa99ba20 with Priority: HIGHEST for action port [ 707.854882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-34f77179-d62b-4bdc-ad25-0f2afa99ba20 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.855045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34f77179-d62b-4bdc-ad25-0f2afa99ba20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.855097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34f77179-d62b-4bdc-ad25-0f2afa99ba20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.855401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34f77179-d62b-4bdc-ad25-0f2afa99ba20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.855611] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f77179-d62b-4bdc-ad25-0f2afa99ba20',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.008511] env[69350]: INFO networking_nsxv3.common.synchronization [None req-370ebd68-a3a2-44ef-893d-220c2fda519a None None] Enqueued Resource ID: fc928cbb-847d-4379-ae2c-70a7fab93865 with Priority: HIGHEST for action port [ 708.008861] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc928cbb-847d-4379-ae2c-70a7fab93865 with Priority: HIGHEST for action port [ 708.010409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc928cbb-847d-4379-ae2c-70a7fab93865 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.010409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc928cbb-847d-4379-ae2c-70a7fab93865" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.010409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc928cbb-847d-4379-ae2c-70a7fab93865" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.010409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc928cbb-847d-4379-ae2c-70a7fab93865" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.010409] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc928cbb-847d-4379-ae2c-70a7fab93865',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.359286] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34f77179-d62b-4bdc-ad25-0f2afa99ba20 [ 708.359286] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.359286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.359286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.359286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.359286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.359705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34f77179-d62b-4bdc-ad25-0f2afa99ba20 already deleted. [ 708.359705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34f77179-d62b-4bdc-ad25-0f2afa99ba20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.514717] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc928cbb-847d-4379-ae2c-70a7fab93865 [ 708.515198] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.515198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.515341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.515481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.515571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.515689] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc928cbb-847d-4379-ae2c-70a7fab93865 already deleted. [ 708.515809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc928cbb-847d-4379-ae2c-70a7fab93865" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.594101] env[69350]: INFO networking_nsxv3.common.synchronization [None req-845308b6-f853-48e6-bcc9-df05dfb0c538 None None] Enqueued Resource ID: 9d6ec137-2edc-4111-91d0-5c58ce92732b with Priority: HIGHEST for action port [ 708.595440] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d6ec137-2edc-4111-91d0-5c58ce92732b with Priority: HIGHEST for action port [ 708.595440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d6ec137-2edc-4111-91d0-5c58ce92732b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.595440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d6ec137-2edc-4111-91d0-5c58ce92732b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.595440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d6ec137-2edc-4111-91d0-5c58ce92732b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.596517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d6ec137-2edc-4111-91d0-5c58ce92732b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.596517] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d6ec137-2edc-4111-91d0-5c58ce92732b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.865256] env[69350]: INFO networking_nsxv3.common.synchronization [req-05b2dab6-aa13-4a27-9ddf-ac94dfdfa621 req-099518ad-f626-4cd1-addd-e6d116db595a service nova] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 708.865440] env[69350]: INFO networking_nsxv3.common.synchronization [req-05b2dab6-aa13-4a27-9ddf-ac94dfdfa621 req-099518ad-f626-4cd1-addd-e6d116db595a service nova] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 708.865660] env[69350]: INFO networking_nsxv3.common.synchronization [req-05b2dab6-aa13-4a27-9ddf-ac94dfdfa621 req-099518ad-f626-4cd1-addd-e6d116db595a service nova] Enqueued Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 708.865860] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 708.866035] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 708.867750] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 708.867750] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.867750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.867750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.868099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.868099] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.868895] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.869023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.869098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.869295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.869456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.869600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.869674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.869834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.869923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.870030] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.873013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.873013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.873013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.873013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.873013] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d7c1a5-a050-4b34-bd94-c6265cf85efb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.921186] env[69350]: INFO networking_nsxv3.common.synchronization [None req-2532cd7c-8892-4996-8f6c-a14874ecacdb None None] Enqueued Resource ID: 2a84da39-3bf9-4a0f-88aa-f31c63898b01 with Priority: HIGHEST for action port [ 708.921186] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a84da39-3bf9-4a0f-88aa-f31c63898b01 with Priority: HIGHEST for action port [ 708.921399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a84da39-3bf9-4a0f-88aa-f31c63898b01 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.921474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a84da39-3bf9-4a0f-88aa-f31c63898b01" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.922549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a84da39-3bf9-4a0f-88aa-f31c63898b01" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.922549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a84da39-3bf9-4a0f-88aa-f31c63898b01" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.922549] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a84da39-3bf9-4a0f-88aa-f31c63898b01',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.041523] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c3b821f3-71e2-4288-97be-41c52afe7746 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 709.042516] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 709.042699] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.042853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.042896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.044358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.044358] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.099343] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d6ec137-2edc-4111-91d0-5c58ce92732b [ 709.099733] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.099885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.099957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.100501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.100501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.100501] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d6ec137-2edc-4111-91d0-5c58ce92732b already deleted. [ 709.100501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d6ec137-2edc-4111-91d0-5c58ce92732b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.283414] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 709.283656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.346623] env[69350]: INFO networking_nsxv3.common.synchronization [req-f867daa4-54d6-4cbe-91fe-03d6d1fb4957 req-0c8619f1-e0c6-4808-a9fc-f1d6ee2f4951 tempest-SecurityGroupRulesNegativeTestJSON-1052915309 tempest-SecurityGroupRulesNegativeTestJSON-1052915309-project-member] Enqueued Resource ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe with Priority: HIGHEST for action security_group_rules [ 709.347410] env[69350]: INFO networking_nsxv3.common.synchronization [None req-64bdc482-ce4a-43d9-847d-bcbc8e0643fa tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 709.347973] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe with Priority: HIGHEST for action security_group_rules [ 709.348196] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 709.348478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.348611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.348678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.348942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.349038] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d207216f-74f9-40b1-8c59-e9d8c13ebbbe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.354429] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.354429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.372974] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.373151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.373315] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.374223] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7d7c1a5-a050-4b34-bd94-c6265cf85efb with status ACTIVE [ 709.374397] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.374512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.374575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.374766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.374853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.375028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.375135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.375198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.375327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.375398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.375570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.375660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.375710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.375846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.375918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.375990] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb is going to be updated. [ 709.401676] env[69350]: INFO networking_nsxv3.common.synchronization [req-a4d90bad-d4ee-4c4a-a47b-4b2fee84dbf6 req-e65907ad-1147-4567-80fb-715e3e1ca458 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 709.402907] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.403061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.403143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.403336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.403472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.403742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.404730] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 709.404730] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.404730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.404730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.404975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.406302] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.407075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.407075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.407075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.407075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.407075] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.425103] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a84da39-3bf9-4a0f-88aa-f31c63898b01 [ 709.425103] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.425103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.425259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.425395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.425437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.425528] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a84da39-3bf9-4a0f-88aa-f31c63898b01 already deleted. [ 709.425609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a84da39-3bf9-4a0f-88aa-f31c63898b01" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.569538] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.569878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.571467] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc already deleted. [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.571467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.571467] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.877936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.877936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.877936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.878306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.878671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.878954] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe already deleted. [ 709.878954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.879169] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.910023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.910023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.910023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.910275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.910310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.911584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.911737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.911805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.912019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.912480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.912480] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 already deleted. [ 709.912480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.098621] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.098621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.098621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.099029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.099029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.099029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc already deleted. [ 710.099029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.239451] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.239451] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.239451] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.239451] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.240387] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.240857] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.241091] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.241426] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.241637] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.241879] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.262881] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.265547] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.265547] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.265547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.265547] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-64fc21f7-26b1-41d0-ba72-adf06df23565 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.265547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.265547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.265547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.265547] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fc21f7-26b1-41d0-ba72-adf06df23565',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.382792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.382792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.382792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.382792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.382792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.382792] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be created. [ 710.411912] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.412099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.412155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.412438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.412601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.425067] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: UNINITIALIZED for 2s [ 710.771415] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.771415] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 64fc21f7-26b1-41d0-ba72-adf06df23565 not found, creating... [ 710.771415] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.771415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.772138] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.772138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.772138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.772138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.772138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.772138] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 64fc21f7-26b1-41d0-ba72-adf06df23565 is going to be created. [ 710.793084] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.793847] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.793847] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.793847] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.793993] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.794194] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.899822] env[69350]: INFO networking_nsxv3.common.synchronization [req-6a54d5aa-3d3e-435d-9bbd-cf7d50d56c4b req-093ec9dd-e2fd-4e61-ba84-558628ef50db tempest-SecurityGroupRulesNegativeTestJSON-1052915309 tempest-SecurityGroupRulesNegativeTestJSON-1052915309-project-member] Enqueued Resource ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe with Priority: HIGHEST for action security_group_rules [ 710.900250] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe with Priority: HIGHEST for action security_group_rules [ 710.900605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.900734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.900734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.900934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.903686] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d207216f-74f9-40b1-8c59-e9d8c13ebbbe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.431715] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.431922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.431922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.432181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.432360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.432360] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d207216f-74f9-40b1-8c59-e9d8c13ebbbe already deleted. [ 711.432445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d207216f-74f9-40b1-8c59-e9d8c13ebbbe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.979358] env[69350]: INFO networking_nsxv3.common.synchronization [req-34c24500-5b00-4743-8e1a-bc9578faf613 req-3be027c7-055a-485e-a06b-242c85990ff3 tempest-AttachInterfacesV270Test-11186757 tempest-AttachInterfacesV270Test-11186757-project-member] Enqueued Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 711.979358] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 with Priority: HIGHEST for action security_group_members [ 711.979358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6c991-1741-482f-bd6f-0a1e7794c335 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.979358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.979358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.981320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.981498] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.981612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.981677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.981850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.981936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.982039] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6c991-1741-482f-bd6f-0a1e7794c335',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.134361] env[69350]: INFO networking_nsxv3.common.synchronization [req-27ea3311-9d07-4308-a7ad-97638f086cc5 req-e4d7d5cf-e89d-40df-9f9a-1c7fbc770adb tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 712.134980] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 712.135196] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.135316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.135380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.135646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.135814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.135935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.135983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.136480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.136480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.136480] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.205054] env[69350]: INFO networking_nsxv3.common.synchronization [req-a4d90bad-d4ee-4c4a-a47b-4b2fee84dbf6 req-d126442e-ae70-44a9-b21d-44b0d8fc03c3 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 712.205252] env[69350]: INFO networking_nsxv3.common.synchronization [req-a4d90bad-d4ee-4c4a-a47b-4b2fee84dbf6 req-d126442e-ae70-44a9-b21d-44b0d8fc03c3 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 712.205394] env[69350]: INFO networking_nsxv3.common.synchronization [req-a4d90bad-d4ee-4c4a-a47b-4b2fee84dbf6 req-d126442e-ae70-44a9-b21d-44b0d8fc03c3 service nova] Enqueued Resource ID: 64fc21f7-26b1-41d0-ba72-adf06df23565 with Priority: HIGHEST for action port [ 712.205899] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 712.206580] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 712.206717] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64fc21f7-26b1-41d0-ba72-adf06df23565 with Priority: HIGHEST for action port [ 712.207110] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.207296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.207793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.207793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.207920] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.208956] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.209146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.209238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.209459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.209681] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.209820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.209914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.210143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.210266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.210387] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.212809] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-64fc21f7-26b1-41d0-ba72-adf06df23565 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.212809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.212809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.212809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.212809] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fc21f7-26b1-41d0-ba72-adf06df23565',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.432549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 712.432771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.432942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.433182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.433379] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.433504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.433569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.433782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.434055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.434055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.434055] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.484317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.484499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.484558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.484772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.484881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.485080] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.485283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.485355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.485514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.485595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.485686] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 is going to be updated. [ 712.515601] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.515754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.515814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.516049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.516198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.525099] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: IN_PROGRESS for 2s [ 712.638819] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.713734] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.713734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.714103] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.714734] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64fc21f7-26b1-41d0-ba72-adf06df23565 with status ACTIVE [ 712.714966] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.715076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.715146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.715355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.715441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.715594] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.715691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.715747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.715906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.715983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.719419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.719602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.719602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.719779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.719861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.719957] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64fc21f7-26b1-41d0-ba72-adf06df23565 is going to be updated. [ 712.746270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.746535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.746535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.746738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.746881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.747063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64fc21f7-26b1-41d0-ba72-adf06df23565" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.907029] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.907343] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.907468] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.907735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.908319] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.908416] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.908667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.909094] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.909312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.909625] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.909869] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.909963] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.910138] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.910300] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.910458] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.910659] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.931763] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.931943] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.932096] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.932280] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.932588] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-88601279-7beb-46c5-849e-f78e4ff54eab taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.932807] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.932934] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.934157] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.934324] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88601279-7beb-46c5-849e-f78e4ff54eab',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.936493] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.936642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.936716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.936897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.937063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.940453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.940453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.940453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.940453] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.942685] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b03e0b16-c65d-459c-8e05-4e9d0672df3a None None] Enqueued Resource ID: a1fa6460-9fe9-48df-a8c5-043e64f1d72b with Priority: HIGHEST for action port [ 712.942915] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1fa6460-9fe9-48df-a8c5-043e64f1d72b with Priority: HIGHEST for action port [ 712.943422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1fa6460-9fe9-48df-a8c5-043e64f1d72b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.944584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1fa6460-9fe9-48df-a8c5-043e64f1d72b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.944687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1fa6460-9fe9-48df-a8c5-043e64f1d72b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.945656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1fa6460-9fe9-48df-a8c5-043e64f1d72b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.945656] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fa6460-9fe9-48df-a8c5-043e64f1d72b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.141845] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.222022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.442447] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.447492] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 88601279-7beb-46c5-849e-f78e4ff54eab not found, creating... [ 713.447492] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.447492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.448148] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.448148] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.448148] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.448148] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.448148] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.448148] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 88601279-7beb-46c5-849e-f78e4ff54eab is going to be created. [ 713.448148] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 713.450578] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1fa6460-9fe9-48df-a8c5-043e64f1d72b [ 713.450752] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.450861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.450926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.452853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.452948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.453064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1fa6460-9fe9-48df-a8c5-043e64f1d72b already deleted. [ 713.453145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1fa6460-9fe9-48df-a8c5-043e64f1d72b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.469455] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.469812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.469812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.469979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.470070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.470296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.470397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.470456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.470608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.470677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.470859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.471082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.471082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.475389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.475389] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be created. [ 713.475389] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.475389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.475804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.475804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.535700] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.535896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.535942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.536156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.536339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.568826] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 713.647662] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.647914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.647914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.648162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.648433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.648433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 713.686729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.686916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.686981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.687274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.687432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.698441] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 713.725223] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.725443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.725494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.725738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.725842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.725949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be created. [ 713.759419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.759703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.759703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.773357] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: UNINITIALIZED for 2s [ 714.425079] env[69350]: INFO networking_nsxv3.common.synchronization [req-27ea3311-9d07-4308-a7ad-97638f086cc5 req-0bba47b7-ad97-4366-b508-883e3690f2ad service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 714.425079] env[69350]: INFO networking_nsxv3.common.synchronization [req-27ea3311-9d07-4308-a7ad-97638f086cc5 req-0bba47b7-ad97-4366-b508-883e3690f2ad service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 714.425079] env[69350]: INFO networking_nsxv3.common.synchronization [req-27ea3311-9d07-4308-a7ad-97638f086cc5 req-0bba47b7-ad97-4366-b508-883e3690f2ad service nova] Enqueued Resource ID: 88601279-7beb-46c5-849e-f78e4ff54eab with Priority: HIGHEST for action port [ 714.426493] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 714.426493] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 714.426493] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601279-7beb-46c5-849e-f78e4ff54eab with Priority: HIGHEST for action port [ 714.426493] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.426493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.426493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.428779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.428779] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.429304] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.429304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.429304] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-88601279-7beb-46c5-849e-f78e4ff54eab taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.429304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.429304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.429520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.429520] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88601279-7beb-46c5-849e-f78e4ff54eab',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.536883] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 in Status: SUCCESS [ 714.537108] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6c991-1741-482f-bd6f-0a1e7794c335 deletion is rescheduled due to dependency. [ 714.537198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6c991-1741-482f-bd6f-0a1e7794c335" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.932247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.932502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.938844] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88601279-7beb-46c5-849e-f78e4ff54eab with status ACTIVE [ 714.939083] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.939224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.939294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.939518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.939662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.939812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.939913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.939975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.940146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.940227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.940816] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.940816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.940816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.940816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.941057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.941057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88601279-7beb-46c5-849e-f78e4ff54eab is going to be updated. [ 714.963030] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.963209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.963265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.963481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.963625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.963786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88601279-7beb-46c5-849e-f78e4ff54eab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.588059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 715.588059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.710148] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 715.710442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.710586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.710826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.711052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.711182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.711240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.711614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.711614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.711614] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.788371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 715.788618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.789350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.789669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.789879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.790015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.790088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.790297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.790420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.790566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.790704] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.214221] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.294387] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.294742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.294920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.298021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.298021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.298021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.298021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.298021] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.686774] env[69350]: INFO networking_nsxv3.common.synchronization [req-73dd9718-3740-42ca-8a31-39056052d71d req-74d218ba-8718-4c76-915f-9d222748281d tempest-ServersAdminNegativeTestJSON-1789430876 tempest-ServersAdminNegativeTestJSON-1789430876-project-member] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 716.687389] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 716.687709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.687835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.687900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.690536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.690536] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.690536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.690536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.690536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.690536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.690536] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.717944] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.803284] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 716.829247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.829247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.829247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.829855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.829855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.829855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.829855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.829855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.829855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.830229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.830229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.830229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.830229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.830373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.830407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.831230] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be created. [ 716.911888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.911888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.912677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.913044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.913511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.928877] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 717.143043] env[69350]: INFO networking_nsxv3.common.synchronization [None req-1b2c9eeb-c3d9-4d25-829c-e4320358d974 None None] Enqueued Resource ID: 701858a4-ddeb-4d38-b2d7-eea6674e2281 with Priority: HIGHEST for action port [ 717.143043] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701858a4-ddeb-4d38-b2d7-eea6674e2281 with Priority: HIGHEST for action port [ 717.143832] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-701858a4-ddeb-4d38-b2d7-eea6674e2281 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.143990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-701858a4-ddeb-4d38-b2d7-eea6674e2281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.143990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-701858a4-ddeb-4d38-b2d7-eea6674e2281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.144263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-701858a4-ddeb-4d38-b2d7-eea6674e2281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.144358] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('701858a4-ddeb-4d38-b2d7-eea6674e2281',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.193664] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.221612] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.221819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.221917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.222134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.222230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.222358] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 717.265059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.265059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.265059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.265059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.265059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.277997] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 717.498261] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.498559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.498777] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.499087] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.499358] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.499566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.499660] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.499949] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.500589] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.500973] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.501168] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.501367] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.501561] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.502239] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.502416] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.502675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.521952] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.521952] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.522065] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.522198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.522507] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-dfc02605-0cea-4a9d-8dc2-251f8a5de252 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.522687] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.522909] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.523793] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.524121] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfc02605-0cea-4a9d-8dc2-251f8a5de252',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.646765] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 701858a4-ddeb-4d38-b2d7-eea6674e2281 [ 717.646982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.647140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.647212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.647430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.647520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.647615] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:701858a4-ddeb-4d38-b2d7-eea6674e2281 already deleted. [ 717.647696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-701858a4-ddeb-4d38-b2d7-eea6674e2281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.698192] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.027480] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.027851] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.028080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.028454] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.028877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.028963] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port dfc02605-0cea-4a9d-8dc2-251f8a5de252 not found, creating... [ 718.030271] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.030271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.030271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.030507] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.030507] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.032443] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.032443] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.032443] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.032443] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.032443] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.032443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: dfc02605-0cea-4a9d-8dc2-251f8a5de252 is going to be created. [ 718.063602] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.063602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.063602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.063602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.064100] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.064100] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.094410] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a08dda61-511a-4646-9077-6b5206e1d637 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 718.095368] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 718.095368] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.095524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.095524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.095767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.095851] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.169808] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 718.169808] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 718.169941] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 718.170091] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 718.170340] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.170594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.170594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.170769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.170953] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.171362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.171551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.171790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.171790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.171915] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.173440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.173624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.173693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.173888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.173968] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.174053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.174120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.174266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.174349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.174441] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.202412] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.202412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.202412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.202412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.202412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.202412] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be updated. [ 718.222246] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_rules [ 718.222883] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 718.222883] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 718.222883] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 718.222883] env[69350]: INFO networking_nsxv3.common.synchronization [req-e28e98d5-f8d8-4fa4-83d8-e0835b85c64a req-455a6f3e-2fc9-45ec-975c-cccc05d327cc tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 718.223482] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_rules [ 718.223621] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 718.223717] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 718.224186] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 718.224417] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 718.224642] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.224726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.224792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.225887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.225887] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.227202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.227202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.227202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.227202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.227202] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.227494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.227494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.227570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.228238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.228336] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d7c1a5-a050-4b34-bd94-c6265cf85efb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.229889] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.229987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.230207] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.230294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.238401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.238817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.238902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.239183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.239339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.255473] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 718.270837] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b9ba65c1-7e90-4761-afb3-ece6c9f48998 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 718.270837] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 718.270837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.270837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.622098] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.622339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.622447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.622639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.622730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.622826] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 already deleted. [ 718.622908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.623076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.623227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.623309] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.675973] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.677046] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.730877] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7d7c1a5-a050-4b34-bd94-c6265cf85efb with status ACTIVE [ 718.731281] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.731281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.731388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.731624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.731703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.731833] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.732030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.732030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.733060] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.733060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.733060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb is going to be updated. [ 718.734391] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.734494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.734735] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.734819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.763918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.764219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.764426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.764721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.764885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.765094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.943682] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 718.943887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.025485] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 719.025485] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 719.026182] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 719.026895] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 719.027119] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 719.027244] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 719.028634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.028634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.028634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.028634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.028634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.029084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.029159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.029243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.029318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.029482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.029561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.029714] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.030567] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.031511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.149996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.150643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.150643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.150643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.150801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.150801] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 already deleted. [ 719.150881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.175604] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_rules [ 719.175899] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 719.176157] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_rules [ 719.176362] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 719.176565] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 719.176784] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 719.177022] env[69350]: INFO networking_nsxv3.common.synchronization [req-19cf52f7-a583-4b63-9707-fd269dafa707 req-f7c370f1-d826-4419-98d2-87649bc0162a tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 719.177694] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_rules [ 719.177879] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_rules [ 719.178017] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 719.178123] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb with Priority: HIGHEST for action port [ 719.178123] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 719.178209] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 719.178293] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 719.178565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.178689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.178891] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.179450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.179905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.179905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.179905] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.180736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.180847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.181042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.182296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.182296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.182296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.182296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.182485] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d7c1a5-a050-4b34-bd94-c6265cf85efb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.183454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.183454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.183722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.184022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.510291] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.510291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.510291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.510291] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.536581] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.552543] env[69350]: INFO networking_nsxv3.common.synchronization [req-73dd9718-3740-42ca-8a31-39056052d71d req-837446b3-e2b9-4b8d-a80b-1518aa01d827 service nova] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_rules [ 719.552705] env[69350]: INFO networking_nsxv3.common.synchronization [req-73dd9718-3740-42ca-8a31-39056052d71d req-837446b3-e2b9-4b8d-a80b-1518aa01d827 service nova] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 719.552936] env[69350]: INFO networking_nsxv3.common.synchronization [req-73dd9718-3740-42ca-8a31-39056052d71d req-837446b3-e2b9-4b8d-a80b-1518aa01d827 service nova] Enqueued Resource ID: dfc02605-0cea-4a9d-8dc2-251f8a5de252 with Priority: HIGHEST for action port [ 719.553062] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_rules [ 719.553486] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 719.553486] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc02605-0cea-4a9d-8dc2-251f8a5de252 with Priority: HIGHEST for action port [ 719.553992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.553992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.554225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.554294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.554361] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.555279] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.555423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.556549] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfc02605-0cea-4a9d-8dc2-251f8a5de252 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.556549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.556549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.556549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.556549] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfc02605-0cea-4a9d-8dc2-251f8a5de252',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.688660] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.688961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.689331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.689567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.689740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.690012] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be created. [ 719.691589] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.693245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.693426] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7d7c1a5-a050-4b34-bd94-c6265cf85efb with status ACTIVE [ 719.693691] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.693855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.693968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.694477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.694585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.695152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.695247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.695247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.695383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.695462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.695602] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7d7c1a5-a050-4b34-bd94-c6265cf85efb is going to be updated. [ 719.699039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.699039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.699039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.699039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.699039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.699039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 719.726227] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.726387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.726468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.726757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.726917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.727142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d7c1a5-a050-4b34-bd94-c6265cf85efb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.728881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.729034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.729155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.729376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.729532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745511] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: UNINITIALIZED for 2s [ 719.749808] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.752898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.752898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.752898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.752898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.764665] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 719.792911] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.793140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.793234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.793577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.793804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.793986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.794137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.794491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.794491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.794673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.794765] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.795049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.795049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.795241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.795606] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.795606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.795606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.795820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.795820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795956] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.981351] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d4954b6-e609-4251-9e07-cb910bc061e3 req-36245c93-b244-4595-a3fa-0e16678acfc7 tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 719.982039] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 719.983078] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.983078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.983078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.983078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.983078] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.983934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.984098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.984308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.984801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.984801] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.040334] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.058052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.058052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.061068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfc02605-0cea-4a9d-8dc2-251f8a5de252 with status ACTIVE [ 720.063224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.063224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.063224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.063715] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.063766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.067022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.067022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.067022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.067022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfc02605-0cea-4a9d-8dc2-251f8a5de252 is going to be updated. [ 720.088212] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.088413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.088531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.089686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.090530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.090530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfc02605-0cea-4a9d-8dc2-251f8a5de252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.268652] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.268652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.268652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.268652] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.299966] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a07d8013-92b1-46a1-acb2-34b3df1ac235: rpc.has_security_group_logging(os_id): False [ 720.319755] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.319755] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.319755] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.319755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.320572] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.321481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.321481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.321481] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 720.326640] env[69350]: INFO networking_nsxv3.common.synchronization [None req-1bfdfc41-5538-4c6c-82f6-be2dff5b5724 None None] Enqueued Resource ID: 93d426eb-34ca-4fd4-8b59-79e830a81d3e with Priority: HIGHEST for action port [ 720.327290] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d426eb-34ca-4fd4-8b59-79e830a81d3e with Priority: HIGHEST for action port [ 720.327512] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-93d426eb-34ca-4fd4-8b59-79e830a81d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.327665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93d426eb-34ca-4fd4-8b59-79e830a81d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.327704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93d426eb-34ca-4fd4-8b59-79e830a81d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.328045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93d426eb-34ca-4fd4-8b59-79e830a81d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.328045] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93d426eb-34ca-4fd4-8b59-79e830a81d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.400851] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.401110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.401110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.401731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.401958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.416803] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 720.486913] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.488132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.489250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.489250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.489250] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 already deleted. [ 720.489250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.527985] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.528201] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.529545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.529545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.529545] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.529545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.529545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.530695] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.530695] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.530695] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.530695] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.530695] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.530695] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.530695] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.531209] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.531337] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.545086] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.545086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.545206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.545388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.545502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.545583] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be created. [ 720.554653] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.554653] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.554653] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.554931] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.555030] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-11798828-16d6-4991-bd39-40909f48141b taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.555212] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.555332] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.555670] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.555791] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11798828-16d6-4991-bd39-40909f48141b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.575732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.575732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.575935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.576136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.576902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.588171] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: UNINITIALIZED for 2s [ 720.773022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.832030] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93d426eb-34ca-4fd4-8b59-79e830a81d3e [ 720.832324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.832432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.832490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.832689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.832842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.832842] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93d426eb-34ca-4fd4-8b59-79e830a81d3e already deleted. [ 720.832947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93d426eb-34ca-4fd4-8b59-79e830a81d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.059904] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.059904] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.060291] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.060428] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.060626] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.060795] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 11798828-16d6-4991-bd39-40909f48141b not found, creating... [ 721.061084] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.061261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.061366] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.061609] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.061748] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.062091] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.062259] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.062379] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.062598] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.062749] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.062910] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 11798828-16d6-4991-bd39-40909f48141b is going to be created. [ 721.089028] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.089028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.089239] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.089372] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.089662] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.089926] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.277676] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.756982] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 721.757241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.757484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.757796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.757910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.758170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.758170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.758413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.758413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.758537] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.776539] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 721.776884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.776884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.777514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.777514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.777514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.777671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.779293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.779293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.779293] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.783761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.783761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.783761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.783761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.784035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.784074] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be updated. [ 721.816316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.816476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.816575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.816808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.816962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.828789] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d4954b6-e609-4251-9e07-cb910bc061e3 req-c6bcf6e0-94e5-4a6c-80a5-a0c9afd27fc0 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d4954b6-e609-4251-9e07-cb910bc061e3 req-c6bcf6e0-94e5-4a6c-80a5-a0c9afd27fc0 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d4954b6-e609-4251-9e07-cb910bc061e3 req-c6bcf6e0-94e5-4a6c-80a5-a0c9afd27fc0 service nova] Enqueued Resource ID: 11798828-16d6-4991-bd39-40909f48141b with Priority: HIGHEST for action port [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 722.073153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11798828-16d6-4991-bd39-40909f48141b with Priority: HIGHEST for action port [ 722.073576] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.073741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.073830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.074121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.074203] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.078229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.078229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.078229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.078229] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.078766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-11798828-16d6-4991-bd39-40909f48141b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.079057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.079342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.079447] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11798828-16d6-4991-bd39-40909f48141b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.261098] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.286820] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.433932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 722.434055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.465020] env[69350]: INFO networking_nsxv3.common.synchronization [req-2ad91947-b0d7-4b50-b351-e70b74c226b9 req-0b0e05dd-aa03-44f4-8cc1-43bc300d8009 tempest-ServerRescueTestJSON-370583535 tempest-ServerRescueTestJSON-370583535-project-member] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 722.465020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 722.465020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.465020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.465020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.465020] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.585102] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.587038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.587038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.587038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11798828-16d6-4991-bd39-40909f48141b with status ACTIVE [ 722.587038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.587038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.587038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.587385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.587385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.587451] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.587555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.587595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.588551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.588551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.588551] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11798828-16d6-4991-bd39-40909f48141b is going to be updated. [ 722.602090] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: SUCCESS [ 722.602291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.603054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.603251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.603436] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.603555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.603622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.603771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.603897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.604310] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.617241] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.617241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.617241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.617241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.617241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.617241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11798828-16d6-4991-bd39-40909f48141b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.764024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.791991] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.903606] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.903819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.903945] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.904290] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.904556] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.904719] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.905914] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.906418] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.906695] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.906978] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.907166] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.907327] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.907494] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.907638] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.907850] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.908390] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.926280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.926454] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.926592] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.926782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.927142] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9a2496ce-f576-4137-8cca-7530cb46073b taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.927323] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.927443] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.927761] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.927903] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2496ce-f576-4137-8cca-7530cb46073b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.970535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.970535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.970535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.970535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.970535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.971019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.971019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.971019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.971019] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 already deleted. [ 722.971019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.090288] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.109020] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.268514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.268715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.268796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.269035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.269136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.269249] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 723.293439] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.293867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.293867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.294165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.294269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.294375] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 723.309543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.309808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.309808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.310033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.310146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.318595] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 723.326720] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.326879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.326879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.327134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.327285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.336352] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 723.434406] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.434617] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.434782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.435063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.435215] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.435368] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 9a2496ce-f576-4137-8cca-7530cb46073b not found, creating... [ 723.435615] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.435786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.435903] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.436143] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.436282] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.436615] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.436828] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.436951] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.438071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.438071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.438071] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9a2496ce-f576-4137-8cca-7530cb46073b is going to be created. [ 723.459188] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.459445] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.459572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.459854] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.460093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.460332] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.595478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.595478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.595478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.595478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.595478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.595478] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be created. [ 723.611838] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.629148] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.629148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.629148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.629148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.629148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.639981] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: UNINITIALIZED for 2s [ 723.672839] env[69350]: INFO networking_nsxv3.common.synchronization [req-ac2fcd7e-f394-4593-8473-05869834f2ee req-c361fb85-7a7d-44d8-b8ea-5b3d8c044cd2 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 723.673461] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 723.674347] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.674525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.674598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.675128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.675128] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.675128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.675449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.675449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.675575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.675575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.840044] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.840044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.840725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.840725] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.115293] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.115515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.115569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.115849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.115953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.116081] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be updated. [ 724.148018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.148212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.148410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.148504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.148654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.157208] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: IN_PROGRESS for 2s [ 724.177852] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.178163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.178163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.178351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.178479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.178607] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.178796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.178796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.179023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.179160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.179256] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 724.240553] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.242099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.242099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.242099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.242099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.251350] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 724.343111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.343287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.343504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.343722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.343722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.343850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.343902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.344051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.344150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.344239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.344385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.344559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.344559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.344676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.344804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.344895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.344948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.346285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.347182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.347182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.347182] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.718197] env[69350]: INFO networking_nsxv3.common.synchronization [req-2ad91947-b0d7-4b50-b351-e70b74c226b9 req-a74b39f2-85e6-401e-82c3-58f12700732c service nova] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_rules [ 724.718391] env[69350]: INFO networking_nsxv3.common.synchronization [req-2ad91947-b0d7-4b50-b351-e70b74c226b9 req-a74b39f2-85e6-401e-82c3-58f12700732c service nova] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 724.718529] env[69350]: INFO networking_nsxv3.common.synchronization [req-2ad91947-b0d7-4b50-b351-e70b74c226b9 req-a74b39f2-85e6-401e-82c3-58f12700732c service nova] Enqueued Resource ID: 9a2496ce-f576-4137-8cca-7530cb46073b with Priority: HIGHEST for action port [ 724.718823] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_rules [ 724.718954] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 724.720300] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2496ce-f576-4137-8cca-7530cb46073b with Priority: HIGHEST for action port [ 724.720908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.721062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.721134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.721406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.721494] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.723410] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.723555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.723640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.723770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.723919] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.724035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.724102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.724254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.724342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.724430] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.725275] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a2496ce-f576-4137-8cca-7530cb46073b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.725402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.725467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.726150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.726150] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2496ce-f576-4137-8cca-7530cb46073b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.850392] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce437c5a-9850-4106-9109-1794494f0682: rpc.has_security_group_logging(os_id): False [ 724.869014] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.869157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.869248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.869457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.869550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.869801] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.869911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.869971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.870172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.870260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.870441] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.870536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.870597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.870736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.870813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.871666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.871771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.871859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.871991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.872082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.872171] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be updated. [ 724.934916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.934916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.934916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.934916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.934916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.951830] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 725.213888] env[69350]: INFO networking_nsxv3.common.synchronization [req-f927aa5c-c0a1-4af6-843a-d035478ca459 req-29318dcc-90a4-4e99-869b-279dde62d270 tempest-ServerDiagnosticsTest-955338129 tempest-ServerDiagnosticsTest-955338129-project-member] Enqueued Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 725.214594] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 725.216229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.216229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.216229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.216561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.216561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.216708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.216753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.216917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.217039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.217132] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.225029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.225285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.232821] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.234621] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a2496ce-f576-4137-8cca-7530cb46073b with status ACTIVE [ 725.238029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.238029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.238029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.238029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.238029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.238029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.238029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.238992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.238992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.238992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.238992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.238992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.238992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.240398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.240398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.240398] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a2496ce-f576-4137-8cca-7530cb46073b is going to be updated. [ 725.265753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.265753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.265753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.265753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.265753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.265753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a2496ce-f576-4137-8cca-7530cb46073b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.331332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 725.331332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.331332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.331566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.331765] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.331907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.331991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.332208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.332303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.332416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.332539] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.334332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.336020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.336020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.336020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.336020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.336020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.336020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.336020] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.353433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 725.353803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.354549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.354845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.356646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.357039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.357163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.357526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.357781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.358040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.358213] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.360135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.360544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.360796] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.361080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.361312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.362066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.362413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.362606] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.636370] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.636597] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.636712] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.637031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.637295] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.637455] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.637574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.637799] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.637945] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.639515] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.639515] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.639515] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.639515] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.639515] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.639699] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.639699] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.651366] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 725.651590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.651760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.651976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.652207] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.652328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.652391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.652554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.652636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.652736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.652830] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.661253] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.661474] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.661589] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.661756] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.663024] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-89b64df4-3c71-4075-a1ea-6ab0a06497f4 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.663024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.663246] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.663405] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.663546] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b64df4-3c71-4075-a1ea-6ab0a06497f4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.722137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.722137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.722137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424865cd-4393-4354-b973-124d1d74b508 already deleted. [ 725.722137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.735372] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.835309] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.839978] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.864960] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.864960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.867099] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.159867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.160120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.160120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.160411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.160594] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.160757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.160819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.161051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.161159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.161254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.161408] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.161535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.161617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.161871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.162045] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.162254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.162346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.162496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.162578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.162702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.162799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.167201] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.167434] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.167575] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.167844] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.168060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.168230] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 89b64df4-3c71-4075-a1ea-6ab0a06497f4 not found, creating... [ 726.168509] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.168716] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.168870] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.172034] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.172034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.172034] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 89b64df4-3c71-4075-a1ea-6ab0a06497f4 is going to be created. [ 726.183534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: SUCCESS [ 726.183766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.183930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.184217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.184419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.184543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.184609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.184772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.184860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.184946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.185053] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.196813] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.197118] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.197303] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.197887] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.198049] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.198442] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.238718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.238936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.239133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.239377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.239493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.239615] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be created. [ 726.263734] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 726.263926] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 726.264060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.297080] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.297080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.297080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.297080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.297080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.316224] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: UNINITIALIZED for 2s [ 726.338932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4938dad0-1aaa-448e-8a86-4203e6ccd867: rpc.has_security_group_logging(os_id): False [ 726.344319] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.360556] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.360727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.360788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.361048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.361184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.361394] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.361492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.361547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.361717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.361848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.361955] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be created. [ 726.369268] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.426635] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.426829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.426906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.427181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.427368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.439908] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 726.664832] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3373549f-c839-4d1c-a55a-af37a3148994: rpc.has_security_group_logging(os_id): False [ 726.687528] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.687774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.687903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.688255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.688463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.688805] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.689018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.689169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.689278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.689340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.689558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.689668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.689751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.690117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.690225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.690584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.690675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.690675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.690832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.690913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.691624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be created. [ 726.693062] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.765926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.766108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.766188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.766390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.766576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.784092] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 726.846621] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.846831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.847258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.847596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.847732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.847848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 726.871710] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.872213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.872213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.872213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.872381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.872381] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 726.922624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.922624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.922930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.922997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.923255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.939440] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 726.972328] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.972486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.972543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.972794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.972957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.981199] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 726.981449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.984941] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 727.144488] env[69350]: INFO networking_nsxv3.common.synchronization [req-f927aa5c-c0a1-4af6-843a-d035478ca459 req-75b53608-a5c7-46fe-b40c-ea631f3fb1ae service nova] Enqueued Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_rules [ 727.144679] env[69350]: INFO networking_nsxv3.common.synchronization [req-f927aa5c-c0a1-4af6-843a-d035478ca459 req-75b53608-a5c7-46fe-b40c-ea631f3fb1ae service nova] Enqueued Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 727.144878] env[69350]: INFO networking_nsxv3.common.synchronization [req-f927aa5c-c0a1-4af6-843a-d035478ca459 req-75b53608-a5c7-46fe-b40c-ea631f3fb1ae service nova] Enqueued Resource ID: 89b64df4-3c71-4075-a1ea-6ab0a06497f4 with Priority: HIGHEST for action port [ 727.145165] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_rules [ 727.145353] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 727.145407] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b64df4-3c71-4075-a1ea-6ab0a06497f4 with Priority: HIGHEST for action port [ 727.145952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.146112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.146185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.146410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.146490] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.148403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.148539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.148603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.148844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.148997] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.149111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.149170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.149322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.149405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.149495] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.152634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b64df4-3c71-4075-a1ea-6ab0a06497f4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.152775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.152851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.152994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.153094] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b64df4-3c71-4075-a1ea-6ab0a06497f4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.196714] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b54caf5-2187-4343-bc88-b3ec40430d8a: rpc.has_security_group_logging(os_id): False [ 727.218449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.219863] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.219863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.220221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.220221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.221551] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be created. [ 727.307805] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.307997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.308109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.308398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.308638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.322139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: IN_PROGRESS for 2s [ 727.654075] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.655423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.655553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.657241] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b64df4-3c71-4075-a1ea-6ab0a06497f4 with status ACTIVE [ 727.657241] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.657476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.657476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.657823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.657823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.657924] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.658012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.658072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.658249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.658421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.658517] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.658620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.658683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.658939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.659060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.659151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b64df4-3c71-4075-a1ea-6ab0a06497f4 is going to be updated. [ 727.683912] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.684100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.684175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.684359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.684484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.684642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b64df4-3c71-4075-a1ea-6ab0a06497f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.810102] env[69350]: INFO networking_nsxv3.common.synchronization [req-a051d698-0ff8-4784-a633-d7e105544337 req-6cb2cda4-68be-4b4c-ac59-686462eae974 tempest-DeleteServersAdminTestJSON-1592801387 tempest-DeleteServersAdminTestJSON-1592801387-project-member] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 727.810102] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 727.810994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.811363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.811912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.812295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.812606] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.814354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.814354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.814354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.814354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.814354] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.158482] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.315819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.315819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.315819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.316053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.316140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.316367] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.320030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.320030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.320030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.320030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.320030] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be updated. [ 728.331531] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 728.331805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.332545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.332805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.333023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.333151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.333250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.333495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.333603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.333702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.333832] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.347693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.347980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.348124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.349055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.349314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.361924] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 728.452240] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 728.452517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.452718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.452963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.453089] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.487970] env[69350]: INFO networking_nsxv3.common.synchronization [req-623234e5-140d-46d7-99bc-ab15cc940d91 req-72f791b5-7f6b-432f-a1ba-491816d3a637 tempest-ServersTestFqdnHostnames-1625487499 tempest-ServersTestFqdnHostnames-1625487499-project-member] Enqueued Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 728.488575] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a with Priority: HIGHEST for action security_group_members [ 728.488927] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-250212f8-b7b8-4a59-919a-a1ed1d003c9a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.490854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.491019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.491897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.494010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.494010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.494010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.494010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.494010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.494010] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250212f8-b7b8-4a59-919a-a1ed1d003c9a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.660397] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.660564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.661405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.661673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.662744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.663288] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424865cd-4393-4354-b973-124d1d74b508 is going to be created. [ 728.687177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.687355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.687355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.687583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.687743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.692346] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.692693] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.692889] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.693199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.693519] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.693713] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.693861] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.694130] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.694311] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.694565] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.694822] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.694822] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.694934] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.695091] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.695229] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.695387] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.698867] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: UNINITIALIZED for 2s [ 728.715654] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.715816] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.719593] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.719593] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.719593] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-dafd00a4-27d2-471b-ad69-1bb7c828390c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.719593] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.719593] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.719593] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.719593] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafd00a4-27d2-471b-ad69-1bb7c828390c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.798781] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 728.799072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.837518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.837679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.837741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.837970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.838155] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.838341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.838408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.841874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.841874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.841874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.841874] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.950268] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 728.950610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.950874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.951245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.951530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.951727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.951850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.952190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.952296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.952431] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.957689] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.957831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.994095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 728.994228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.994384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.994601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.994773] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.994922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.994983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.995162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.995241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.995358] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.996266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.000644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.000748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.000961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.001153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.001564] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.001564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.001671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.001753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.001828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.001942] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a is going to be updated. [ 729.030887] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.031105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.031105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.031309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.031449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.040965] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: IN_PROGRESS for 2s [ 729.222404] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.222832] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.222923] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.223329] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.223524] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.223739] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port dafd00a4-27d2-471b-ad69-1bb7c828390c not found, creating... [ 729.224166] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.224404] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.224575] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.224916] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.225125] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.225535] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.225884] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.225973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.226254] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.226449] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.226697] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: dafd00a4-27d2-471b-ad69-1bb7c828390c is going to be created. [ 729.258434] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.258806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.259021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.259469] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.259840] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.260230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.341200] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: SUCCESS [ 729.341200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.344711] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdbb2071-5801-4662-9a75-aa174ebd2139: rpc.has_security_group_logging(os_id): False [ 729.374027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.374518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.374756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.375379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.375675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.376095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.376375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.376490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.376836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.377070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.377487] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.377710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.377836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.378052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.378140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.378511] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.378704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.378842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.379214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.379321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.379490] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be created. [ 729.459567] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.504366] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.641021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.641021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.641021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.641021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.641021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.654552] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 729.962538] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.007301] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.373810] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 730.374385] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 deletion is rescheduled due to dependency. [ 730.374385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.467874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.468131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.468235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.468489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.500145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.500145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 730.503278] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.503278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.503278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.503278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.503278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.511269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.511434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.511495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.511721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.511820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.511927] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 730.513762] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 730.544352] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.544352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.544352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.544352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.544492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.561817] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 730.710814] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: SUCCESS [ 730.711045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.714029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.714029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.714029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [req-a051d698-0ff8-4784-a633-d7e105544337 req-14742357-b6a1-4569-8e90-73fe87bbf4c4 service nova] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_rules [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [req-a051d698-0ff8-4784-a633-d7e105544337 req-14742357-b6a1-4569-8e90-73fe87bbf4c4 service nova] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [req-a051d698-0ff8-4784-a633-d7e105544337 req-14742357-b6a1-4569-8e90-73fe87bbf4c4 service nova] Enqueued Resource ID: dafd00a4-27d2-471b-ad69-1bb7c828390c with Priority: HIGHEST for action port [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_rules [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 730.790554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafd00a4-27d2-471b-ad69-1bb7c828390c with Priority: HIGHEST for action port [ 730.790554] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.790554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.790554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.790554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.790554] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.790554] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.790905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.790905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.790905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.791234] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.791234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.791234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.791417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.791465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.791645] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.800267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-dafd00a4-27d2-471b-ad69-1bb7c828390c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.800267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.800267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.800267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.800267] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafd00a4-27d2-471b-ad69-1bb7c828390c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.891502] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b137c98-fb5c-4e49-9a00-7533121d910d req-c8bdec38-4a23-4fba-a999-f605f48961c4 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 730.892293] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 730.893114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.893114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.893114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.893114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.893306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.893366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.893450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.893588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.893674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.893779] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.051428] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a in Status: SUCCESS [ 731.051618] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250212f8-b7b8-4a59-919a-a1ed1d003c9a deletion is rescheduled due to dependency. [ 731.051735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250212f8-b7b8-4a59-919a-a1ed1d003c9a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.215467] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.215675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.215767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.216052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.216443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.216598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.216696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.216898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.217012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.217143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.217409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.217574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.217574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.217703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.217880] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.218058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.218104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.218242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.218322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.218406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.218495] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.299554] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.300287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.300287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.300443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dafd00a4-27d2-471b-ad69-1bb7c828390c with status ACTIVE [ 731.300537] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.300655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.300876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.301021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.301146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.301375] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.301534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.301634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.301980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.301980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.302182] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.302277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.302339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.302482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.302554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.302638] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dafd00a4-27d2-471b-ad69-1bb7c828390c is going to be updated. [ 731.318725] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.319028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.319158] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.321413] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.321750] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.321931] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.322080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.322328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.322505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.322681] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.322796] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.322941] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.323040] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.323131] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.323238] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.323372] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.326067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.326192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.326255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.326438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.326569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.326721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dafd00a4-27d2-471b-ad69-1bb7c828390c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.345677] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.345921] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.346117] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.346309] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.346866] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5490feb0-c9cd-4578-bed2-469c1c697813 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.346993] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.347119] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.347408] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.347545] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5490feb0-c9cd-4578-bed2-469c1c697813',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.396077] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.396389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.396389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.396550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.396649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.396909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.397031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.397098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.397262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.397381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.397475] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 already deleted. [ 731.397560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.668582] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 731.668874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.725680] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 424865cd-4393-4354-b973-124d1d74b508: rpc.has_security_group_logging(os_id): False [ 731.745608] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.745853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.746014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.746329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.746492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.746828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.746968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.747051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.747289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.747390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.747597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.747736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.747837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.748033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.748136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.748398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.748508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.748592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.748833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.748916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.749039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424865cd-4393-4354-b973-124d1d74b508 is going to be created. [ 731.805122] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.814133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.814309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.814419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.814689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.814906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.025787] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: IN_PROGRESS for 2s [ 732.027420] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.027770] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.027971] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.028383] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.028794] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.028920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5490feb0-c9cd-4578-bed2-469c1c697813 not found, creating... [ 732.029373] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.029674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.029914] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.031162] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.031442] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.032158] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.032158] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.032395] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.033815] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.033906] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.034606] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5490feb0-c9cd-4578-bed2-469c1c697813 is going to be created. [ 732.309388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.309576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.310116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.310116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.310116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.310116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be updated. [ 732.343515] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.343682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.343738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.343940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.344105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.346976] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.347194] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.347331] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.347605] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.347819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.348047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.354500] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 732.524477] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 732.524735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.524779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.525015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.525216] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.525349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.525432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.525604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.525689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.525777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.525943] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.574604] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 732.575328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.575684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.576059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.576416] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.576727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.576873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.577151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.577317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.577474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.577705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.577918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.578070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.578315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.578545] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.578751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.578953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.579328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.579477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.579634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.579839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.029116] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.082270] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 733.120829] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.121211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.121211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.121463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.121611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.121877] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.121988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.122411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.123292] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.123292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.123792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.123792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.123792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.123878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.123878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.124338] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 733.205431] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.205602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.205676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.205931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.206106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.229180] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 733.234046] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b137c98-fb5c-4e49-9a00-7533121d910d req-a7f7cf10-55bc-4881-b49f-657fa2f79556 service nova] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 733.234261] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b137c98-fb5c-4e49-9a00-7533121d910d req-a7f7cf10-55bc-4881-b49f-657fa2f79556 service nova] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 733.234401] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b137c98-fb5c-4e49-9a00-7533121d910d req-a7f7cf10-55bc-4881-b49f-657fa2f79556 service nova] Enqueued Resource ID: 5490feb0-c9cd-4578-bed2-469c1c697813 with Priority: HIGHEST for action port [ 733.234656] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_rules [ 733.234791] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 733.234883] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5490feb0-c9cd-4578-bed2-469c1c697813 with Priority: HIGHEST for action port [ 733.239341] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.239543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.239622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.239899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.239899] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.244146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.244146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.244146] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.244146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5490feb0-c9cd-4578-bed2-469c1c697813 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.244146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.244749] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5490feb0-c9cd-4578-bed2-469c1c697813',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.533488] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4938dad0-1aaa-448e-8a86-4203e6ccd867: rpc.has_security_group_logging(os_id): False [ 733.552926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.552926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.552926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.552926] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 733.613689] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.613689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.613689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.613689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.613689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.625691] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 733.892095] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.892095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5490feb0-c9cd-4578-bed2-469c1c697813 with status ACTIVE [ 733.892095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.892095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.892095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.892585] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.892585] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5490feb0-c9cd-4578-bed2-469c1c697813 is going to be updated. [ 733.892585] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.892585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5490feb0-c9cd-4578-bed2-469c1c697813" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.042428] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: SUCCESS [ 734.042666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.364889] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 734.365210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.365459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.365712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.365916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.366048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.366107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.366275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.366359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.366447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.366539] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.395210] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.872043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.872299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.872333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.872686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.872888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.872997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.873078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.873240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.873334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.873424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.873567] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.873659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.873721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.873859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.873992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.874095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.874288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.874362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.874444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.874533] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.897122] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.897299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.897401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.897675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.897675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.897828] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 is going to be created. [ 734.927836] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.928026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.928161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.928407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.928614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.942778] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: UNINITIALIZED for 2s [ 735.245213] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 735.245213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.245368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.245590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.245682] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.377258] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3ca168c-7530-47a3-aa0d-a5c0012eaf61: rpc.has_security_group_logging(os_id): False [ 735.398634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.398856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.398958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.399505] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.399602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.399665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.400076] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.400170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.400321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.400405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.400445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.400630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.400714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.400817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.400909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.401015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.401151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be updated. [ 735.468937] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.469127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.469196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.469373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.469515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.482546] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 735.645060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 735.645060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.750035] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.750035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.750035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.750784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.751869] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.752124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.752124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.752286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.752378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.753105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.753105] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.258980] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.259588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.259588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.259588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.259739] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.259868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.259962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.260153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.260245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.260357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.260525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.260620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.260673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.260842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.260979] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.261107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.261169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.261360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.262260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.262260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.262260] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.763807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 736.783695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.783871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.783936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.784148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.784244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.784466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.784570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.784631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.784782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.784857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.785046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.785143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.785300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.785352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.785399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.785657] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.785751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.785809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.785980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.786218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.786310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 736.848473] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.848606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.848673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.848926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.849089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.864157] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 736.955851] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: SUCCESS [ 736.956194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.956325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.957065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.957065] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.957065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.957065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.957065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.957326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.957326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.957326] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.463322] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.498069] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 737.498307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.966705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01249833-e649-48c7-b9c6-9d9107bdff51: rpc.has_security_group_logging(os_id): False [ 737.995109] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.995295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.995295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.995642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.995956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.996269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.996429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.996635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.997418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.997418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.997418] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 is going to be created. [ 738.132800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.132964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.133034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.133343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.136077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.161329] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: IN_PROGRESS for 2s [ 738.235893] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 738.236130] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 738.617443] env[69350]: INFO networking_nsxv3.common.synchronization [req-597c6710-4094-4bbe-9f6a-c80531b655b6 req-d2a2a474-de59-4f4e-a61c-1ec112cbafb0 tempest-ServersAdminNegativeTestJSON-1789430876 tempest-ServersAdminNegativeTestJSON-1789430876-project-member] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 738.617443] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 738.617443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.617443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.617443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.617443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.617443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.617443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.617443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.618611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.618611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.618611] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.884218] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 738.884488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.120716] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.624426] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.900595] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6864187a-14ce-4664-a419-59bff536c8e9 None None] Enqueued Resource ID: 7459f27f-5fc3-4070-8887-3cfdae573065 with Priority: HIGHEST for action port [ 739.901384] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7459f27f-5fc3-4070-8887-3cfdae573065 with Priority: HIGHEST for action port [ 739.901483] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7459f27f-5fc3-4070-8887-3cfdae573065 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.901748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7459f27f-5fc3-4070-8887-3cfdae573065" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.901748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7459f27f-5fc3-4070-8887-3cfdae573065" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.901929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7459f27f-5fc3-4070-8887-3cfdae573065" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.902018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7459f27f-5fc3-4070-8887-3cfdae573065',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.129891] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.131375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.131500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.131805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.131946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.132101] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be updated. [ 740.173043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.173151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.173187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.173426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.173638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.178057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: SUCCESS [ 740.178280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.187579] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 740.405941] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7459f27f-5fc3-4070-8887-3cfdae573065 [ 740.407460] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.407460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.407460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.407460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.407460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.407460] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7459f27f-5fc3-4070-8887-3cfdae573065 already deleted. [ 740.407460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7459f27f-5fc3-4070-8887-3cfdae573065" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.450197] env[69350]: INFO networking_nsxv3.common.synchronization [req-732a1c91-4af4-4e3d-a859-970aec539ae9 req-20970e36-06fa-4a13-bb58-4f16e1ed8f5a tempest-ServerDiagnosticsTest-955338129 tempest-ServerDiagnosticsTest-955338129-project-member] Enqueued Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 740.450834] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGHEST for action security_group_members [ 740.451810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.452028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.452143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.452393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.452603] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.452848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.453670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.453670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.453670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.453670] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.958205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.958467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.958467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.959289] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.959807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424865cd-4393-4354-b973-124d1d74b508 is going to be updated. [ 740.990769] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.990925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.991012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.991313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.995023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.003100] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: IN_PROGRESS for 2s [ 742.205684] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 742.205684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.530402] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a5608606-54f4-440a-88ee-991c29a3ac98 None None] Enqueued Resource ID: 7790a390-4a91-40c9-a93c-0827803cfbf7 with Priority: HIGHEST for action port [ 742.530402] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7790a390-4a91-40c9-a93c-0827803cfbf7 with Priority: HIGHEST for action port [ 742.530402] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7790a390-4a91-40c9-a93c-0827803cfbf7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.530402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7790a390-4a91-40c9-a93c-0827803cfbf7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.530402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7790a390-4a91-40c9-a93c-0827803cfbf7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.530402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7790a390-4a91-40c9-a93c-0827803cfbf7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.530402] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7790a390-4a91-40c9-a93c-0827803cfbf7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.028055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424865cd-4393-4354-b973-124d1d74b508 in Status: SUCCESS [ 743.028055] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424865cd-4393-4354-b973-124d1d74b508 deletion is rescheduled due to dependency. [ 743.028055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.039989] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7790a390-4a91-40c9-a93c-0827803cfbf7 [ 743.039989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.039989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.039989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.039989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.039989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.039989] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7790a390-4a91-40c9-a93c-0827803cfbf7 already deleted. [ 743.039989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7790a390-4a91-40c9-a93c-0827803cfbf7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.894297] env[69350]: INFO networking_nsxv3.common.synchronization [req-46931de6-03e1-4ecc-b795-1de7f1eeea34 req-c16a6b50-a2c0-4473-a8d5-09cfc8ebd60c tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 743.896742] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 743.897552] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.897731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.898502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.898502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.898740] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.898961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.899394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.899394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.899929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.900244] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.404780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.404780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.406069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.406069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.406069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.406669] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.406839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.406933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.407075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.407195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.407253] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 744.454825] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.454998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.455057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.455280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.455426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.465813] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 744.860858] env[69350]: INFO networking_nsxv3.common.synchronization [req-a0c80add-1358-47f6-a133-f8089a75c10a req-d09528f4-8d83-4b11-9523-6b61268a7029 tempest-DeleteServersAdminTestJSON-1592801387 tempest-DeleteServersAdminTestJSON-1592801387-project-member] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 744.862089] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGHEST for action security_group_members [ 744.862970] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.865348] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.865348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.865348] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.896542] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-43ad721e-1085-47a7-83fc-382abb2b2080 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 744.896542] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 744.896840] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.897580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.897580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.897580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.897580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.898683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.898683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.898683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.898683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.898683] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.368067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.368302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.368373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.368632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.368702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.368987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.368987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.369111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.369202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.369281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.369362] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be updated. [ 745.404040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.404040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.404040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.404040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.404040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.406453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.412068] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.412068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.412068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 745.413665] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.414022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.414251] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.418968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.418968] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.418968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.418968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.418968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.418968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.418968] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.418968] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.418968] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.418968] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.418968] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.418968] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.418968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.418968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: IN_PROGRESS for 2s [ 745.440079] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.440277] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.440608] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.440608] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.440935] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-0c47b34b-6f9b-410d-897b-87e75e0d43e1 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.441095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.441628] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.441628] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.441721] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c47b34b-6f9b-410d-897b-87e75e0d43e1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.453019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.453019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.453019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.453019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.453019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.463750] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 745.947596] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.947954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.947954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.949021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.949021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.949021] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 0c47b34b-6f9b-410d-897b-87e75e0d43e1 not found, creating... [ 745.949021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.949205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.949205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.949426] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.949559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.949840] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.949992] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.950141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.950348] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.950479] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.950613] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 0c47b34b-6f9b-410d-897b-87e75e0d43e1 is going to be created. [ 745.978024] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.978024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.978024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.978024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.978024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.978024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.480340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 746.480340] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a deletion is rescheduled due to dependency. [ 746.480340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.694239] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-c9d62a9c-562e-4cb0-b827-cf7e18b4a215 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 746.694428] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-c9d62a9c-562e-4cb0-b827-cf7e18b4a215 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 746.694565] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-c9d62a9c-562e-4cb0-b827-cf7e18b4a215 service nova] Enqueued Resource ID: 0c47b34b-6f9b-410d-897b-87e75e0d43e1 with Priority: HIGHEST for action port [ 746.698472] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 746.698727] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 746.699067] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c47b34b-6f9b-410d-897b-87e75e0d43e1 with Priority: HIGHEST for action port [ 746.699478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.699918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.699918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.704130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.704233] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.707513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.707513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.707513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c47b34b-6f9b-410d-897b-87e75e0d43e1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.707513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.707513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.707513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.707513] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c47b34b-6f9b-410d-897b-87e75e0d43e1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.183065] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-ec5bc338-db25-43f8-a598-fe774b19c006 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 747.183600] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 747.183898] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.184009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.209817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.210754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213734] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c47b34b-6f9b-410d-897b-87e75e0d43e1 with status ACTIVE [ 747.213734] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.213734] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.213734] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.213734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.213734] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c47b34b-6f9b-410d-897b-87e75e0d43e1 is going to be updated. [ 747.236046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.236244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.236291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.236472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.236603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.236754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c47b34b-6f9b-410d-897b-87e75e0d43e1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.431996] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 in Status: SUCCESS [ 747.432263] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 deletion is rescheduled due to dependency. [ 747.432378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.477094] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 747.477288] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 deletion is rescheduled due to dependency. [ 747.477398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.477557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.477807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.478232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.478388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.478453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.478629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.478711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.478803] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.702128] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.702351] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.702477] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.703039] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.703334] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.703496] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.703614] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.704187] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.704187] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.704291] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.704365] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.704487] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.704597] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.704707] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.704829] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.704940] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.728248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.728446] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.728579] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.728838] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.734177] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.734177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.734177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.734177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.734177] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ba08d2-bc9f-4a66-870b-3d698b0d7c78',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.882355] env[69350]: INFO networking_nsxv3.common.synchronization [None req-1cca5a13-30c4-44f5-8909-e8e575b49666 None None] Enqueued Resource ID: ff7f390a-f490-4e63-864b-99df3706f275 with Priority: HIGHEST for action port [ 747.883511] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff7f390a-f490-4e63-864b-99df3706f275 with Priority: HIGHEST for action port [ 747.884662] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff7f390a-f490-4e63-864b-99df3706f275 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.885573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff7f390a-f490-4e63-864b-99df3706f275" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.885799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff7f390a-f490-4e63-864b-99df3706f275" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.886160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff7f390a-f490-4e63-864b-99df3706f275" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.886334] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff7f390a-f490-4e63-864b-99df3706f275',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.982401] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.240347] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.240660] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.240763] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.241107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.241218] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.241370] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 not found, creating... [ 748.241814] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.241890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.241963] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.242713] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.242865] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.243225] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.243388] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.243526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.244613] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.244757] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.244907] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 is going to be created. [ 748.275759] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.275990] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.276207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.276413] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.276642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.276880] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.389166] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff7f390a-f490-4e63-864b-99df3706f275 [ 748.390757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.390757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.390757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.390757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.390757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.390757] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff7f390a-f490-4e63-864b-99df3706f275 already deleted. [ 748.390757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff7f390a-f490-4e63-864b-99df3706f275" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.411790] env[69350]: INFO networking_nsxv3.common.synchronization [req-e2f4c096-e558-4640-a827-b267306a7121 req-cb603302-47ae-4031-848b-a7a44d64cb0c tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 748.412405] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 748.412680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.412793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.412864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.414258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.414472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.414661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.414737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.414993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.415102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.415202] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.485511] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.918874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.919155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.919246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.919487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.919595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.919799] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.919918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.920009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.920151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.920241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.920334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 748.972641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.972808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.972878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.973140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.973293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.984317] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 748.987888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.988051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.988095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.988328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.988519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.988519] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 749.038026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.038212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.038242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.038481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.038615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.049143] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 749.450667] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-653dfbad-4741-4c95-b393-3ede987c7cc2 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 749.450910] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-653dfbad-4741-4c95-b393-3ede987c7cc2 service nova] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 749.451071] env[69350]: INFO networking_nsxv3.common.synchronization [req-c9011f85-804a-4538-b7d4-ec1387309583 req-653dfbad-4741-4c95-b393-3ede987c7cc2 service nova] Enqueued Resource ID: 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 with Priority: HIGHEST for action port [ 749.451279] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_rules [ 749.451414] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 749.452093] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 with Priority: HIGHEST for action port [ 749.452778] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.452896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.456152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.456152] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ba08d2-bc9f-4a66-870b-3d698b0d7c78',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.961266] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 with status ACTIVE [ 749.961266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.961266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.961266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.961266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.961266] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78ba08d2-bc9f-4a66-870b-3d698b0d7c78 is going to be updated. [ 749.990282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.990282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.990282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.990282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78ba08d2-bc9f-4a66-870b-3d698b0d7c78" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.467424] env[69350]: INFO networking_nsxv3.common.synchronization [req-7bb2703b-4186-45a1-8c1e-66a41de92f95 req-c3b35329-6086-4a2a-86ff-f2acdbba4e7e tempest-TenantUsagesTestJSON-324950818 tempest-TenantUsagesTestJSON-324950818-project-member] Enqueued Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 750.468130] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 750.468563] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.468815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.469038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.469466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.469695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.469916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.471254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.471254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.471254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.471254] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.493042] env[69350]: INFO networking_nsxv3.common.synchronization [None req-4f6b5172-6af3-41b3-a5ec-c67813d854f3 None None] Enqueued Resource ID: 7756216d-57d5-456a-b860-9d7737e29dd4 with Priority: HIGHEST for action port [ 750.493042] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7756216d-57d5-456a-b860-9d7737e29dd4 with Priority: HIGHEST for action port [ 750.493042] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7756216d-57d5-456a-b860-9d7737e29dd4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.493042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7756216d-57d5-456a-b860-9d7737e29dd4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.493042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7756216d-57d5-456a-b860-9d7737e29dd4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.493042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7756216d-57d5-456a-b860-9d7737e29dd4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.493042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7756216d-57d5-456a-b860-9d7737e29dd4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.946837] env[69350]: INFO networking_nsxv3.common.synchronization [req-d36fe26e-d06f-4e2b-9d6e-ab6a0ebe9d2a req-c17ef47f-a9d5-454f-9bb2-6731ca79259e tempest-VolumesAssistedSnapshotsTest-1004854712 tempest-VolumesAssistedSnapshotsTest-1004854712-project-member] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 750.947601] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGHEST for action security_group_members [ 750.947956] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.948109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.948179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.948405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.948577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.948677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.948869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.948955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.949046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.949166] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.973630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.973630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.973630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.973630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.973630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.973962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.974429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.974429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.974429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.974683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.974683] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 already deleted. [ 750.974753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.993781] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7756216d-57d5-456a-b860-9d7737e29dd4 [ 750.994173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.994446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.994446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.994814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.994910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.995078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7756216d-57d5-456a-b860-9d7737e29dd4 already deleted. [ 750.995206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7756216d-57d5-456a-b860-9d7737e29dd4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.996431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 750.996669] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 deletion is rescheduled due to dependency. [ 750.996805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.063272] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 751.063487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.063664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.064045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.064233] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.064233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.064339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.064437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.064519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.064637] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.453632] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.453900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.453900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.454423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.454423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.454423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.455052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.455052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.455052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.455052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.455052] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 is going to be updated. [ 751.470282] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.470622] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.470622] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.470777] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.473558] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.473558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.473558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.473558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.473558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.473558] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.473558] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.473558] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.473558] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.473558] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.473558] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.473558] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.483646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.483839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.483839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.484115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.484211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.493894] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: IN_PROGRESS for 2s [ 751.496758] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.496920] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.497200] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.497456] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.498337] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-57faebba-9d3d-437d-96e6-506cf2d2719c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.498412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.498533] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.498852] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.499054] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57faebba-9d3d-437d-96e6-506cf2d2719c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.569848] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.006614] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.007160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.007646] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.009995] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 57faebba-9d3d-437d-96e6-506cf2d2719c not found, creating... [ 752.009995] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.009995] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.009995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.010559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.010592] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.010854] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.011070] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 57faebba-9d3d-437d-96e6-506cf2d2719c is going to be created. [ 752.039050] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.039680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.039680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.039821] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.040180] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.040455] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.073340] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.584102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.584102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.584102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.584102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.584102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.584102] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 752.618805] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.618805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.618914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.619141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.619348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.630717] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 752.839999] env[69350]: INFO networking_nsxv3.common.synchronization [req-7bb2703b-4186-45a1-8c1e-66a41de92f95 req-94be2122-b174-4c91-9638-fb956ece12de service nova] Enqueued Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_rules [ 752.840225] env[69350]: INFO networking_nsxv3.common.synchronization [req-7bb2703b-4186-45a1-8c1e-66a41de92f95 req-94be2122-b174-4c91-9638-fb956ece12de service nova] Enqueued Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 752.840366] env[69350]: INFO networking_nsxv3.common.synchronization [req-7bb2703b-4186-45a1-8c1e-66a41de92f95 req-94be2122-b174-4c91-9638-fb956ece12de service nova] Enqueued Resource ID: 57faebba-9d3d-437d-96e6-506cf2d2719c with Priority: HIGHEST for action port [ 752.840609] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_rules [ 752.840739] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 752.840850] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57faebba-9d3d-437d-96e6-506cf2d2719c with Priority: HIGHEST for action port [ 752.841405] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.841534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.841602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.841857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.841939] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.844401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.846040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.846040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.846137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.847450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.849031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.849031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.849031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.849031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.849031] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.849031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-57faebba-9d3d-437d-96e6-506cf2d2719c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.849348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.849904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.850124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.850208] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57faebba-9d3d-437d-96e6-506cf2d2719c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.352782] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.354352] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.354862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.355306] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57faebba-9d3d-437d-96e6-506cf2d2719c with status ACTIVE [ 753.355437] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.355551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.358021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.358021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.358021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.358774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.358774] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57faebba-9d3d-437d-96e6-506cf2d2719c is going to be updated. [ 753.381684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.381866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.381908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.382249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.382329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.382474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57faebba-9d3d-437d-96e6-506cf2d2719c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.504935] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 in Status: SUCCESS [ 753.505124] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 deletion is rescheduled due to dependency. [ 753.505233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.855514] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.358765] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.358765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.358765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.359166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.359166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.359270] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 is going to be created. [ 754.385600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.385717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.385717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.385921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.386095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.398487] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: UNINITIALIZED for 2s [ 754.640503] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 754.640797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.641042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.641314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.641560] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.641718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.641809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.641994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.642122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.642216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.642315] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.643149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.643314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.643460] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.643559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.643615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.643765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.643843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.643926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.146133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.146520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.146573] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.649305] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.151628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.151959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.151959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.152277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.152328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.152465] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 756.183814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.183990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.184204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.184345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.184432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.196146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 756.411759] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: SUCCESS [ 756.412511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.412511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.412620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.412903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.413060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.413130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.413346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.413438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.413567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.413752] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.915888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.916439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.916439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.916736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.917021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.917231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.917370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.918311] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.918311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.918548] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.918548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.918623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.919252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.919252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.919252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.919252] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.386048] env[69350]: INFO networking_nsxv3.common.synchronization [req-45ea668b-59a3-49bf-83d7-31cf777d849b req-d30cc99a-4412-468c-91f2-97493042690a tempest-ServerAddressesNegativeTestJSON-799692279 tempest-ServerAddressesNegativeTestJSON-799692279-project-member] Enqueued Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 757.386486] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 757.386788] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.386907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.386968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.387257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.387403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.387503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.387566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.387707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.387794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.387880] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.421745] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b3f1231-5b5f-4abe-9574-aad015f9f344: rpc.has_security_group_logging(os_id): False [ 757.445020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.445020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.445020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.445020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.445608] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.445608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.445608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.445608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.445721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.445949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 is going to be created. [ 757.512925] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.515022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.515022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.515022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.515022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.526251] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: IN_PROGRESS for 2s [ 757.816851] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.817076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-175" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.817232] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-175" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.817611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-175" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.817943] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.818064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.818107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.819028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.819028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.819028] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.819028] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.819028] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.819028] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.819306] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.819306] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.819371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.843308] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.843308] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.843462] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.845189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-175" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.845189] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-75831de5-5e09-4ff1-ae93-03ec8036c80a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.845189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.845189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.845189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.845189] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75831de5-5e09-4ff1-ae93-03ec8036c80a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.890527] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.891298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.891298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.891298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.891298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.891601] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.891763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.891866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.892506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.892506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.892506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b already deleted. [ 757.892506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.210530] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 758.210530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.210530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.210530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.210815] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.210815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.210815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.210928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.210957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.211039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.211196] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.211294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.211355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.211525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.211901] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.211901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.211901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.211901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.212154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.212154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.212208] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.348324] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.348579] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.348684] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.348979] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.349190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.349387] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 75831de5-5e09-4ff1-ae93-03ec8036c80a not found, creating... [ 758.349689] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.349860] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.349976] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.350230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.350398] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.350696] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.350853] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.350969] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.352743] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.352893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.353055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 75831de5-5e09-4ff1-ae93-03ec8036c80a is going to be created. [ 758.378093] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.378438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.378710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.378899] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.379245] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.379532] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.714440] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44290e3f-7c0d-4bde-a194-fd1b6df88740: rpc.has_security_group_logging(os_id): False [ 758.736270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.736517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.736517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.736671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.736767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.737073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.737264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.737341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.737523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.737615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.737816] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.737914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.737977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.738148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.738225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.738425] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.738519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.738581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.738721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.738797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.738885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 758.806997] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.808382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.808382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.808382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.808382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.829464] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 759.245112] env[69350]: INFO networking_nsxv3.common.synchronization [req-45ea668b-59a3-49bf-83d7-31cf777d849b req-efc98239-e86c-4559-ae3a-fd0d9968259e service nova] Enqueued Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_rules [ 759.245317] env[69350]: INFO networking_nsxv3.common.synchronization [req-45ea668b-59a3-49bf-83d7-31cf777d849b req-efc98239-e86c-4559-ae3a-fd0d9968259e service nova] Enqueued Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 759.245449] env[69350]: INFO networking_nsxv3.common.synchronization [req-45ea668b-59a3-49bf-83d7-31cf777d849b req-efc98239-e86c-4559-ae3a-fd0d9968259e service nova] Enqueued Resource ID: 75831de5-5e09-4ff1-ae93-03ec8036c80a with Priority: HIGHEST for action port [ 759.245953] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_rules [ 759.246109] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 759.246213] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75831de5-5e09-4ff1-ae93-03ec8036c80a with Priority: HIGHEST for action port [ 759.246497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.246612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.246682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.247051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.247051] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.247899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.248030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.248085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.249901] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.249901] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.249901] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-75831de5-5e09-4ff1-ae93-03ec8036c80a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.249901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.250387] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75831de5-5e09-4ff1-ae93-03ec8036c80a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.538542] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: SUCCESS [ 759.538771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.751901] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.753059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.753187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.757209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75831de5-5e09-4ff1-ae93-03ec8036c80a with status ACTIVE [ 759.757209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.757209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.757209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.757209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.757209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75831de5-5e09-4ff1-ae93-03ec8036c80a is going to be updated. [ 759.777712] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.778071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.778142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.778351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.778558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.778809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75831de5-5e09-4ff1-ae93-03ec8036c80a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.180171] env[69350]: INFO networking_nsxv3.common.synchronization [req-1b3df089-d542-4348-8410-a2c7ad836062 req-f098cf42-8610-4913-9433-a96c0b9b3cd1 tempest-FloatingIPsAssociationNegativeTestJSON-86964046 tempest-FloatingIPsAssociationNegativeTestJSON-86964046-project-member] Enqueued Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 760.180709] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 760.181034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.181125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.181197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.181503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.181684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.181684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.181943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.181943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.182026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.182217] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.258148] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.434233] env[69350]: INFO networking_nsxv3.common.synchronization [None req-e37e00c0-b785-416e-8c91-96ae277a7325 None None] Enqueued Resource ID: fca44632-d07d-4c23-97ab-e14f71a6c8c4 with Priority: HIGHEST for action port [ 760.434852] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44632-d07d-4c23-97ab-e14f71a6c8c4 with Priority: HIGHEST for action port [ 760.436032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca44632-d07d-4c23-97ab-e14f71a6c8c4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.436185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca44632-d07d-4c23-97ab-e14f71a6c8c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.436272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca44632-d07d-4c23-97ab-e14f71a6c8c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.436566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca44632-d07d-4c23-97ab-e14f71a6c8c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.436654] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca44632-d07d-4c23-97ab-e14f71a6c8c4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.665435] env[69350]: INFO networking_nsxv3.common.synchronization [req-cfe9f37d-7bea-4d63-8c5f-22f8fb600ca4 req-11ab386f-2bdf-40f5-9df2-09e12c01dde6 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 760.666026] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 760.666335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.666634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.666634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.666752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.667727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.667727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.667727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.667999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.668089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.668385] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.684930] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.685243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.685328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.685543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.685636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.685833] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.685930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.686139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.686229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.686229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.686310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 already deleted. [ 760.686385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.761986] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.762259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.762435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.762690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.762842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.762998] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b is going to be created. [ 760.791637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.791774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.791836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.792068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.796019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.804804] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: UNINITIALIZED for 2s [ 760.839836] env[69350]: INFO networking_nsxv3.common.synchronization [req-96a7361c-c82a-4ec9-9139-38fb9ddd0b7b req-948d0f9e-65e8-4161-8f63-d3e7b3ee1af7 tempest-MultipleCreateTestJSON-663694527 tempest-MultipleCreateTestJSON-663694527-project-member] Enqueued Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 760.839836] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 with Priority: HIGHEST for action security_group_members [ 760.839836] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-44290e3f-7c0d-4bde-a194-fd1b6df88740 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.839836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.850297] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 760.850297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.850297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.850297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.850297] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.938637] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fca44632-d07d-4c23-97ab-e14f71a6c8c4 [ 760.938942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.940466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.940466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.940626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.940626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.940740] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fca44632-d07d-4c23-97ab-e14f71a6c8c4 already deleted. [ 760.940781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca44632-d07d-4c23-97ab-e14f71a6c8c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.062805] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-719 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.062805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-719" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.063025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-719" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.063276] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-719" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.063563] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.063755] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.063881] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.064120] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.064361] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.064617] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.064673] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.064747] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.064868] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.064965] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.065080] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.065222] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.085567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.085708] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.085864] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.086668] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-719" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.087058] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-2698f9b8-db60-4c96-8d40-3e9ac6da442a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.087276] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.087402] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.087727] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.087866] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2698f9b8-db60-4c96-8d40-3e9ac6da442a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.172356] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.381287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.381536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.381596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.382146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.382146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.382146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be deleted. [ 761.438639] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.438639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.438639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.438639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.438639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.438639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.591641] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.591641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.591641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.591641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.591641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.592141] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 2698f9b8-db60-4c96-8d40-3e9ac6da442a not found, creating... [ 761.592141] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.592141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.592250] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.592446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.592592] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.592870] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.593038] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.593160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.593371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.593505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.593643] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 2698f9b8-db60-4c96-8d40-3e9ac6da442a is going to be created. [ 761.615444] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.615629] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.615737] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.616064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.616307] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.616588] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.674450] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.177235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.177616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.177616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.177717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.177778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.177878] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be updated. [ 762.209766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.209947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.210029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.210224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.210431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.221590] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: IN_PROGRESS for 2s [ 762.767129] env[69350]: INFO networking_nsxv3.common.synchronization [None req-7fe06ff7-cdff-42b6-811e-b08d22009dd9 None None] Enqueued Resource ID: eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c with Priority: HIGHEST for action port [ 762.767645] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c with Priority: HIGHEST for action port [ 762.767932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.769082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.769216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.769502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.769583] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.776653] env[69350]: INFO networking_nsxv3.common.synchronization [req-1b3df089-d542-4348-8410-a2c7ad836062 req-f93df4c4-5342-4822-a260-7109af6aaea7 service nova] Enqueued Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_rules [ 762.776832] env[69350]: INFO networking_nsxv3.common.synchronization [req-1b3df089-d542-4348-8410-a2c7ad836062 req-f93df4c4-5342-4822-a260-7109af6aaea7 service nova] Enqueued Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 762.776969] env[69350]: INFO networking_nsxv3.common.synchronization [req-1b3df089-d542-4348-8410-a2c7ad836062 req-f93df4c4-5342-4822-a260-7109af6aaea7 service nova] Enqueued Resource ID: 2698f9b8-db60-4c96-8d40-3e9ac6da442a with Priority: HIGHEST for action port [ 762.777216] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_rules [ 762.777358] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 762.777456] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2698f9b8-db60-4c96-8d40-3e9ac6da442a with Priority: HIGHEST for action port [ 762.777959] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.778142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.778214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.778459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.778584] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.780773] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.780773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.780773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.780773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.780773] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.780979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.780979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.781129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.781227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.781317] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.783345] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2698f9b8-db60-4c96-8d40-3e9ac6da442a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.783458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.783501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.783650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.783730] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2698f9b8-db60-4c96-8d40-3e9ac6da442a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.817316] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: SUCCESS [ 762.817459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.817565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.817785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.817975] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.818110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.818175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.818329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.818410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.818491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.818575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.272350] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c [ 763.272651] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.272651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.272651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.272798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.272924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.273017] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c already deleted. [ 763.273102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb1c4c4f-4fee-4faa-a89c-9419c89c9f2c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.281127] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.281127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.286515] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.287626] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2698f9b8-db60-4c96-8d40-3e9ac6da442a with status ACTIVE [ 763.287838] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.287985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.290125] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.290125] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.290125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.290125] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2698f9b8-db60-4c96-8d40-3e9ac6da442a is going to be updated. [ 763.320818] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.320818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.320818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.321088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.321396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.321396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.321396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.321683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.321683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.321683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.321842] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.321957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.322032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.322179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.322319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.322410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.322469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.322607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.322686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.322835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.322951] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.324705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.324833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.324889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.325079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.325211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.325383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2698f9b8-db60-4c96-8d40-3e9ac6da442a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.792145] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.827611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 193b59c8-d498-494a-9dfe-d3babfd0943b: rpc.has_security_group_logging(os_id): False [ 763.843762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.843931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.843975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.844237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.844331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.844557] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.844658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.844722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.844874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.844950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.846017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.846017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.846017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.846327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.846327] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b is going to be created. [ 763.904889] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.905063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.905160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.905345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.905531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.917067] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: IN_PROGRESS for 2s [ 764.234070] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 in Status: SUCCESS [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.234070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.234070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.234669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.234669] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44290e3f-7c0d-4bde-a194-fd1b6df88740',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.294531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.294854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.294854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.295202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.295363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.295514] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 is going to be created. [ 764.320780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.320937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.320988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.321303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.321523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.334776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: UNINITIALIZED for 2s [ 764.737685] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.737884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.737961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.738261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.738412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.738797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.738896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.739087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.739207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.739307] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44290e3f-7c0d-4bde-a194-fd1b6df88740 is going to be deleted. [ 764.781360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.781602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.781694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.781921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.782042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.782147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44290e3f-7c0d-4bde-a194-fd1b6df88740" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.905678] env[69350]: INFO networking_nsxv3.common.synchronization [req-a761032e-af2b-43f5-b1a6-b5d5521bc5c8 req-40ad9199-81e7-4e32-9fc8-9a4cf0ec7b7d tempest-InstanceActionsNegativeTestJSON-1157188796 tempest-InstanceActionsNegativeTestJSON-1157188796-project-member] Enqueued Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 765.906831] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 765.906831] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.907053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.907053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.907477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.907477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.907594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.908954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.908954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.908954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.908954] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.932234] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: SUCCESS [ 765.932234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.344623] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: SUCCESS [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.347218] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.347218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.347218] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.413105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.413287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.413415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.413715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.413880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.414131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.414287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.414387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.414597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.414721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.415204] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf already deleted. [ 766.415204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.450849] env[69350]: INFO networking_nsxv3.common.synchronization [req-0e35f69b-89ca-465c-ad39-60ca2cc72f53 req-796f56e1-d5c7-4d68-81f2-c5df4afe2044 tempest-TenantUsagesTestJSON-324950818 tempest-TenantUsagesTestJSON-324950818-project-member] Enqueued Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 766.451393] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGHEST for action security_group_members [ 766.451693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.451823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.451892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.452958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.453192] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.453346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.453451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.453655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.453789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.453926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.604723] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.604970] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-891" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.605125] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-891" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.605512] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-891" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.605803] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.605968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.606117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.606346] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.606496] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.606711] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.606821] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.608128] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.608325] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.608463] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.608583] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.608725] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.641302] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.641302] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 766.641302] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.641302] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-891" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.641604] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6b14c740-2824-4070-906b-85c18284a403 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.641840] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.642048] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.642477] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.642704] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b14c740-2824-4070-906b-85c18284a403',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.851302] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.851514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.851585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.851759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.851923] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.852042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.852126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.852320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.852414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.852533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.852668] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.852764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.852842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.853031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.853193] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.853312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.853473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.853563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.853637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.853742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.853855] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.955910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.956502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.956502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.956502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.956502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.958062] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.958062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.958062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.958062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.958062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.958062] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 is going to be updated. [ 766.999754] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.999919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.999969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.000867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.000867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.013945] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: IN_PROGRESS for 2s [ 767.146809] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.146809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.146809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.147239] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.147369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.147903] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6b14c740-2824-4070-906b-85c18284a403 not found, creating... [ 767.148063] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.148745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.148745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.148903] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.149033] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.149529] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.149729] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.149853] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.150206] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.150341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.150513] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6b14c740-2824-4070-906b-85c18284a403 is going to be created. [ 767.197076] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.197531] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.197705] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.198918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.198918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.198918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.359997] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d3a437f-2228-4b2f-acaf-32ef289c6c55: rpc.has_security_group_logging(os_id): False [ 767.384979] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.385209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.385287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.385517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.385611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.385853] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.385955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.386031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.386210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.386291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.386477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.386593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.386715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.386822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.386922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.387193] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.387273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.387327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.387532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.387635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.387752] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 is going to be created. [ 767.466574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.466769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.466880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.467176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.467373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.479952] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: IN_PROGRESS for 2s [ 767.984250] env[69350]: INFO networking_nsxv3.common.synchronization [req-a761032e-af2b-43f5-b1a6-b5d5521bc5c8 req-0a37c638-b553-436e-8340-e7d2e2056d9b service nova] Enqueued Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_rules [ 767.984517] env[69350]: INFO networking_nsxv3.common.synchronization [req-a761032e-af2b-43f5-b1a6-b5d5521bc5c8 req-0a37c638-b553-436e-8340-e7d2e2056d9b service nova] Enqueued Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 767.984659] env[69350]: INFO networking_nsxv3.common.synchronization [req-a761032e-af2b-43f5-b1a6-b5d5521bc5c8 req-0a37c638-b553-436e-8340-e7d2e2056d9b service nova] Enqueued Resource ID: 6b14c740-2824-4070-906b-85c18284a403 with Priority: HIGHEST for action port [ 767.984800] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_rules [ 767.984928] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 767.985034] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b14c740-2824-4070-906b-85c18284a403 with Priority: HIGHEST for action port [ 767.985942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.986222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.986297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.989520] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.989520] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.989520] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.989520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.989520] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.991038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b14c740-2824-4070-906b-85c18284a403 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.991205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.991205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.991389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.991467] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b14c740-2824-4070-906b-85c18284a403',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.496029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.496029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.496029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b14c740-2824-4070-906b-85c18284a403 with status ACTIVE [ 768.496029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.496029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.496029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.501213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.501213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.501213] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.501213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.501213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.501537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.501778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.502082] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b14c740-2824-4070-906b-85c18284a403 is going to be updated. [ 768.526448] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.526448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.526448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.526448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.526448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.526448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b14c740-2824-4070-906b-85c18284a403" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.995812] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.025791] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 in Status: SUCCESS [ 769.025981] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 deletion is rescheduled due to dependency. [ 769.026093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.492591] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: SUCCESS [ 769.492819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.498356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.498539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.498539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.498757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.499376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.499376] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf is going to be created. [ 769.527339] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.527459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.527536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.527761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.527919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.544197] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: UNINITIALIZED for 2s [ 771.283108] env[69350]: INFO networking_nsxv3.common.synchronization [req-f56e1bbe-f5f9-4377-92ab-39b2c05b6095 req-d7cadbb2-8de3-4b82-b9e5-43e8aafa5e39 tempest-ServersAdminNegativeTestJSON-1789430876 tempest-ServersAdminNegativeTestJSON-1789430876-project-member] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 771.287030] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGHEST for action security_group_members [ 771.287030] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.287030] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.287030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.287030] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.550698] env[69350]: INFO networking_nsxv3.common.synchronization [req-058318ae-b3ae-40f8-b04f-b503c7a3f482 req-c1eacddd-46c6-449b-b5ac-06269bef3ba9 tempest-ServerAddressesNegativeTestJSON-799692279 tempest-ServerAddressesNegativeTestJSON-799692279-project-member] Enqueued Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 771.551335] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGHEST for action security_group_members [ 771.551684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.551810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.551871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.552088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.552243] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.552343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.552402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.552564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.552651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.552744] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.560705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: SUCCESS [ 771.560910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.561480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.561797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.563899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.564134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.564207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.564407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.564511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.564603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.564695] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.788268] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.788268] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.788268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.788268] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be updated. [ 771.815765] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.815950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.816809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.816809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.816809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.827042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: IN_PROGRESS for 2s [ 772.059072] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.059317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.059466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.059699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.060023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.060083] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.060154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.060236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.060413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.060485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.060571] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b is going to be updated. [ 772.066844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.067371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.067599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.068043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.068142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.068322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.068542] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.068739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.068739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.068867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.069076] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.069303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.069303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.069450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.069600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.069691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.069787] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.094240] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.094240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.094240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.094240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.094240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.107104] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: IN_PROGRESS for 2s [ 772.572511] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efb6e556-70f9-462a-8a83-e3a295e192cf: rpc.has_security_group_logging(os_id): False [ 772.596303] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.596456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.596528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.597404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.597404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.599433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.599953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599953] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf is going to be created. [ 772.664252] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.664436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.664476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.664676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.664856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.675721] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: IN_PROGRESS for 2s [ 773.346889] env[69350]: INFO networking_nsxv3.common.synchronization [req-aec5fcd7-48a6-491c-b06e-471d63b55b48 req-3de76834-407a-4da3-bf01-c0d12af699b5 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 773.347553] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 773.347871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.348242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.348242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.348531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.348695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.348800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.348862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.349031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.349122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.349256] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.852103] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce437c5a-9850-4106-9109-1794494f0682 in Status: SUCCESS [ 773.852394] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce437c5a-9850-4106-9109-1794494f0682 deletion is rescheduled due to dependency. [ 773.852431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.852793] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.852908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.852981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.853207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.853296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.853479] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.853580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.853643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.853798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.853874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.853957] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc already deleted. [ 773.854052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.120213] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 193b59c8-d498-494a-9dfe-d3babfd0943b in Status: SUCCESS [ 774.120213] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b deletion is rescheduled due to dependency. [ 774.120213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.442378] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.443280] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.443629] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443799] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.444191] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.444483] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.444711] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.444711] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.444851] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.444949] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.445098] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.445196] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.445343] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.468697] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.468903] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.468986] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.469800] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.469800] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c86f8dba-e3db-4df1-8dc6-413396b23bce taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.470319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.470319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.470415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.470506] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86f8dba-e3db-4df1-8dc6-413396b23bce',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.691047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: SUCCESS [ 774.691289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.972995] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.973305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.973341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.973619] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.973842] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.973921] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c86f8dba-e3db-4df1-8dc6-413396b23bce not found, creating... [ 774.974213] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.974375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.974496] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.974722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.974861] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.975150] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.975305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.975423] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.975632] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.975766] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.975903] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c86f8dba-e3db-4df1-8dc6-413396b23bce is going to be created. [ 775.001414] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.001631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.001796] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.002076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.002318] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.002545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.293087] env[69350]: INFO networking_nsxv3.common.synchronization [None req-21345426-0262-4fb9-9c7d-5c4aed751df4 None None] Enqueued Resource ID: 45ee4b8c-8b1b-463e-84e2-b8ae18de9e57 with Priority: HIGHEST for action port [ 775.293266] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ee4b8c-8b1b-463e-84e2-b8ae18de9e57 with Priority: HIGHEST for action port [ 775.293836] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ee4b8c-8b1b-463e-84e2-b8ae18de9e57 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.294011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ee4b8c-8b1b-463e-84e2-b8ae18de9e57" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.294085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ee4b8c-8b1b-463e-84e2-b8ae18de9e57" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.295720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ee4b8c-8b1b-463e-84e2-b8ae18de9e57" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.296965] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ee4b8c-8b1b-463e-84e2-b8ae18de9e57',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.799685] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45ee4b8c-8b1b-463e-84e2-b8ae18de9e57 [ 775.799955] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.800108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.800198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.800422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.800514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.800605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45ee4b8c-8b1b-463e-84e2-b8ae18de9e57 already deleted. [ 775.800682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ee4b8c-8b1b-463e-84e2-b8ae18de9e57" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.121743] env[69350]: INFO networking_nsxv3.common.synchronization [req-aec5fcd7-48a6-491c-b06e-471d63b55b48 req-977ee0b6-3c96-4a28-9d04-085ae5d65209 service nova] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 776.121998] env[69350]: INFO networking_nsxv3.common.synchronization [req-aec5fcd7-48a6-491c-b06e-471d63b55b48 req-977ee0b6-3c96-4a28-9d04-085ae5d65209 service nova] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 776.122122] env[69350]: INFO networking_nsxv3.common.synchronization [req-aec5fcd7-48a6-491c-b06e-471d63b55b48 req-977ee0b6-3c96-4a28-9d04-085ae5d65209 service nova] Enqueued Resource ID: c86f8dba-e3db-4df1-8dc6-413396b23bce with Priority: HIGHEST for action port [ 776.122796] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 776.122968] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 776.123807] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f8dba-e3db-4df1-8dc6-413396b23bce with Priority: HIGHEST for action port [ 776.123807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.123807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.123807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.124349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.124349] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.125577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.125741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.125789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.126264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.126459] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.131824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.131824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.131824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.131824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.131824] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.132242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c86f8dba-e3db-4df1-8dc6-413396b23bce taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.132242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.132242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.132382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.132382] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86f8dba-e3db-4df1-8dc6-413396b23bce',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.635561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.635872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.635933] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.639936] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c86f8dba-e3db-4df1-8dc6-413396b23bce with status ACTIVE [ 776.639936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.639936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.639936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.640326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.640326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.640326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.640326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.640660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.640660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.640660] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c86f8dba-e3db-4df1-8dc6-413396b23bce is going to be updated. [ 776.664730] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.664895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.664895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.666022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.669106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.669441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c86f8dba-e3db-4df1-8dc6-413396b23bce" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.143031] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.527029] env[69350]: INFO networking_nsxv3.common.synchronization [None req-099cbdbb-e1d0-4173-b09e-e42fc61a95c4 None None] Enqueued Resource ID: 818d510c-d383-446e-90b5-4e0b495c8fad with Priority: HIGHEST for action port [ 777.527798] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 818d510c-d383-446e-90b5-4e0b495c8fad with Priority: HIGHEST for action port [ 777.528772] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-818d510c-d383-446e-90b5-4e0b495c8fad taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.529028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-818d510c-d383-446e-90b5-4e0b495c8fad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.529028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-818d510c-d383-446e-90b5-4e0b495c8fad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.529357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-818d510c-d383-446e-90b5-4e0b495c8fad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.530087] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818d510c-d383-446e-90b5-4e0b495c8fad',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.646499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.646499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.646499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.646921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.647054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.647159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be created. [ 777.685215] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.687604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.687604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.687604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.687604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.698513] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: UNINITIALIZED for 2s [ 777.762203] env[69350]: INFO networking_nsxv3.common.synchronization [None req-87af3507-15ca-4479-ae0a-c3caed6374c2 tempest-ServersV294TestFqdnHostnames-993868252 tempest-ServersV294TestFqdnHostnames-993868252-project-member] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 777.762751] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 777.763133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.763266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.763348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.763608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.763697] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.890868] env[69350]: INFO networking_nsxv3.common.synchronization [None req-fe17e328-19f7-4275-a796-24d47bb422e9 tempest-ServersV294TestFqdnHostnames-993868252 tempest-ServersV294TestFqdnHostnames-993868252-project-member] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 777.891450] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 777.891884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.892021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.031455] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 818d510c-d383-446e-90b5-4e0b495c8fad [ 778.031789] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.031964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.032068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.032709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.032709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.032709] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:818d510c-d383-446e-90b5-4e0b495c8fad already deleted. [ 778.032709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-818d510c-d383-446e-90b5-4e0b495c8fad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.297039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.298587] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b already deleted. [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.298587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.298828] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.829951] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.829951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.829951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.829951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.830207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.830207] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b already deleted. [ 778.830278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.252635] env[69350]: INFO networking_nsxv3.common.synchronization [req-733084d6-8474-4ffd-890d-f7b2058e4fb4 req-3fe00c31-4bb7-41ec-a30d-44740347dce5 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 779.253351] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 779.254336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.254493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.254566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.255057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.255057] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.255173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.255173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.255332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.255379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.255497] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.710821] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 779.711615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.711951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.712343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.712657] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.712853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.712968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.713598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.713763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.713955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.714158] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.762663] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.762862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.762980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.764352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.764479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.765113] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.765246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.765334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.765524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.765640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.765733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 already deleted. [ 779.765827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.059408] env[69350]: INFO networking_nsxv3.common.synchronization [req-3618da6e-163e-4d2a-9d31-93691cf7ac9e req-225c7302-b75a-49e2-a71b-6cf7f955b3a3 tempest-ServersTestJSON-666805160 tempest-ServersTestJSON-666805160-project-member] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 780.061138] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGHEST for action security_group_members [ 780.061540] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.061762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.061762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.061960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.062104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.062256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.062256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.062432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.063065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.063211] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.219614] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.402024] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.402024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.402024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.402234] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.402345] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.402543] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.402659] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.403019] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.403842] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.403842] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.403842] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.403842] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.403842] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.403842] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.404057] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.404159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.425971] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.426196] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.426367] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.426558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-193" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.426870] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-a7d3b49e-ddfa-414c-94e9-df175e925d48 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.427198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.427198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.427558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.427697] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d3b49e-ddfa-414c-94e9-df175e925d48',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.571226] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.571226] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.571226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.571226] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 is going to be updated. [ 780.604566] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.604566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.604566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.604566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.604566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.617853] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: IN_PROGRESS for 2s [ 780.722491] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f159146-6707-4314-98f2-9023803a47fc: rpc.has_security_group_logging(os_id): False [ 780.745669] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.745816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.745887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.746128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.746216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.746465] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.746598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.746678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.746867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.746999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.747047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be created. [ 780.810878] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.811100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.811187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.811448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.811725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.825234] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 780.930279] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.931510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.931510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.931510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.931510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.931807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port a7d3b49e-ddfa-414c-94e9-df175e925d48 not found, creating... [ 780.932111] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.932313] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.932438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.932740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.933147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.933340] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.933608] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.933783] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.934062] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.935045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.935045] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 is going to be created. [ 780.960040] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.960040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.960040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.960040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.960040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.960456] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.972184] env[69350]: INFO networking_nsxv3.common.synchronization [req-c768595c-c517-4559-b83b-6cc54158887f req-ca1a8c6d-8816-4d31-a4be-de000317b887 tempest-InstanceActionsNegativeTestJSON-1157188796 tempest-InstanceActionsNegativeTestJSON-1157188796-project-member] Enqueued Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 780.972184] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGHEST for action security_group_members [ 780.972184] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.972184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.972184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.972184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.972184] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.972535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.972535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.973547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.973547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.973547] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.477531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.477705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.477786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.478039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.478186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.478454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.478563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.478643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.478823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.478930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.479065] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf is going to be updated. [ 781.513676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.513676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.513676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.513676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.513676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.526129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: IN_PROGRESS for 2s [ 781.780028] env[69350]: INFO networking_nsxv3.common.synchronization [req-733084d6-8474-4ffd-890d-f7b2058e4fb4 req-283157ff-a325-4e4d-a4d7-d8eb713b1ec2 service nova] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 781.780269] env[69350]: INFO networking_nsxv3.common.synchronization [req-733084d6-8474-4ffd-890d-f7b2058e4fb4 req-283157ff-a325-4e4d-a4d7-d8eb713b1ec2 service nova] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 781.780371] env[69350]: INFO networking_nsxv3.common.synchronization [req-733084d6-8474-4ffd-890d-f7b2058e4fb4 req-283157ff-a325-4e4d-a4d7-d8eb713b1ec2 service nova] Enqueued Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 781.780575] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 781.780706] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 781.780795] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 781.781553] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.781553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.781766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.781810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.781890] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.785831] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.785831] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.785831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.785831] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.786975] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d3b49e-ddfa-414c-94e9-df175e925d48 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.786975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.786975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.789206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.789206] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d3b49e-ddfa-414c-94e9-df175e925d48',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.290995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.291182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.291361] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.292378] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d3b49e-ddfa-414c-94e9-df175e925d48 with status ACTIVE [ 782.292547] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.292660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.292726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.292949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.293063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.293229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.293331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.293410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.293542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.293626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.293791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.293885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.293963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.294409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.294409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.294409] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 is going to be updated. [ 782.318335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.318476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.318551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.318762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.318902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.319176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.629698] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc83992c-258f-4908-a0ee-f421d5b307a0 in Status: SUCCESS [ 782.629698] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 deletion is rescheduled due to dependency. [ 782.629698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.796459] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.837977] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 782.838297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.299103] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.299409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.299568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.299752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.299878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.300131] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be created. [ 783.355098] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.355364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.355497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.355839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.356251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.371904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: UNINITIALIZED for 2s [ 783.645384] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb6e556-70f9-462a-8a83-e3a295e192cf in Status: SUCCESS [ 783.645384] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf deletion is rescheduled due to dependency. [ 783.645384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.696020] env[69350]: INFO networking_nsxv3.common.synchronization [req-b2e5c5e1-adf1-4df6-945c-af023743f3bc req-3ead61e4-b5d6-4249-bf0e-2576a2840628 tempest-FloatingIPsAssociationNegativeTestJSON-86964046 tempest-FloatingIPsAssociationNegativeTestJSON-86964046-project-member] Enqueued Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 784.696020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGHEST for action security_group_members [ 784.696020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.696618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.696822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.697154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.697467] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.697726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.699166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.699166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.699166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.699166] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.204611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.204851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.204851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.205117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.205217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.205427] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.205533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.205597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.205786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.205880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.205968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 is going to be updated. [ 785.243804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.245667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.245667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.245667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.245873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.257325] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: IN_PROGRESS for 2s [ 785.382190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 785.382190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.382190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.382190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.382418] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.382499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.382572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.382751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.382833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.382946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.383192] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.885747] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.388534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32ecc864-31bf-4d87-a9b7-ca366c086e55: rpc.has_security_group_logging(os_id): False [ 786.412163] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.412163] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.412163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.412163] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be created. [ 786.478020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.478020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.478020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.478020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.478020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.491584] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: IN_PROGRESS for 2s [ 787.266971] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 in Status: SUCCESS [ 787.266971] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 deletion is rescheduled due to dependency. [ 787.267339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.505012] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 788.505012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.680732] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d771525d-1602-4ae0-979e-c2b56a92c2f4 tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 with Priority: HIGHEST for action security_group_rules [ 789.681141] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 with Priority: HIGHEST for action security_group_rules [ 789.681141] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.681278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.681278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.681521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.681599] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff8a82b2-92c3-4142-b55d-e4afff838aa8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.775304] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9dd220fb-1406-467c-af6a-154a005d318f tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 with Priority: HIGHEST for action security_group_rules [ 789.775826] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 with Priority: HIGHEST for action security_group_rules [ 789.776358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.776358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.202063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.202063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.202063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.202368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.202368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.202462] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 already deleted. [ 790.202538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.202685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.202838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.202915] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff8a82b2-92c3-4142-b55d-e4afff838aa8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.725520] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.725799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.725799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.725951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.726075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.726186] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff8a82b2-92c3-4142-b55d-e4afff838aa8 already deleted. [ 790.726270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff8a82b2-92c3-4142-b55d-e4afff838aa8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.776300] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 794.776561] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 796.606965] env[69350]: INFO networking_nsxv3.common.synchronization [req-5357bf38-bc56-426e-a80f-526895a4ef6a req-291c8c8c-7e2e-424d-a46e-c2aa52aa67ce tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 796.607836] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 796.608631] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.608631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.608788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.610109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.610109] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.610109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.610109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.610109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.610109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.610109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.001060] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.001288] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.001716] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.001716] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.002009] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.002707] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.002959] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.004123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.004123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.004417] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.004597] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.004787] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.005137] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.005298] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.005515] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.005782] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.028600] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.029569] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.029569] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.029998] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.031236] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-932f8448-cb0e-4854-9e80-520a0b55ce51 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.031236] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.031236] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.031645] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.031678] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932f8448-cb0e-4854-9e80-520a0b55ce51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.114356] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.242638] env[69350]: INFO networking_nsxv3.common.synchronization [req-77d32d0e-eb9b-4776-a4ce-ef2542c52469 req-c2e1ea54-911f-45cc-be0b-9f061eb4514a tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 797.243128] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 797.243868] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.244617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.244617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.244617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.244934] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.245152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.245310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.245594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.245788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.246164] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.534825] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.535210] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.535642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.536442] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.536679] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.537202] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 932f8448-cb0e-4854-9e80-520a0b55ce51 not found, creating... [ 797.537653] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.537938] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.538084] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.538327] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.539050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.539679] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.539914] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.540135] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.540531] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.540708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.540891] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 932f8448-cb0e-4854-9e80-520a0b55ce51 is going to be created. [ 797.562210] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.562436] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.562563] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.562845] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.563085] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.563337] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.612744] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.613068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.613580] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.614070] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.614468] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.614686] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.616421] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.616421] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.616421] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.616421] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.616421] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.616421] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.616421] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.616421] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.616649] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.616796] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.618694] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.649780] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.649780] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.650033] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.650642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.650850] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-faee5bfa-fa04-41f9-9b97-0bbab151af2a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.651688] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.651688] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.651910] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.652155] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faee5bfa-fa04-41f9-9b97-0bbab151af2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.748386] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.748661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.748661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.748856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.748955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.749648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.749648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.749648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.749648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.749959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.749959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d already deleted. [ 797.749959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.122171] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.124942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.124942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.124942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.124942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.124942] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 798.157510] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.157510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port faee5bfa-fa04-41f9-9b97-0bbab151af2a not found, creating... [ 798.157510] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.157510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.158296] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.158704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.159432] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.160384] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.161141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.161141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.161141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.161451] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: faee5bfa-fa04-41f9-9b97-0bbab151af2a is going to be created. [ 798.164204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.164591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.164788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.165270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.165546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.175602] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 798.190045] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.190045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.190045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.190045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.190045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.190045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.289143] env[69350]: INFO networking_nsxv3.common.synchronization [req-5357bf38-bc56-426e-a80f-526895a4ef6a req-91fa2c6a-215e-4024-ba61-f0732234dfa6 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 798.289143] env[69350]: INFO networking_nsxv3.common.synchronization [req-5357bf38-bc56-426e-a80f-526895a4ef6a req-91fa2c6a-215e-4024-ba61-f0732234dfa6 service nova] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 798.289143] env[69350]: INFO networking_nsxv3.common.synchronization [req-5357bf38-bc56-426e-a80f-526895a4ef6a req-91fa2c6a-215e-4024-ba61-f0732234dfa6 service nova] Enqueued Resource ID: 932f8448-cb0e-4854-9e80-520a0b55ce51 with Priority: HIGHEST for action port [ 798.289143] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_rules [ 798.289143] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 798.289475] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932f8448-cb0e-4854-9e80-520a0b55ce51 with Priority: HIGHEST for action port [ 798.290040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.290533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.290734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.291049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.291222] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.293495] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.293766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.294250] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-932f8448-cb0e-4854-9e80-520a0b55ce51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.294579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.294728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.295027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.295193] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932f8448-cb0e-4854-9e80-520a0b55ce51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.798392] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 932f8448-cb0e-4854-9e80-520a0b55ce51 with status ACTIVE [ 798.798392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.798392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.798392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.798392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.798392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.798392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.799354] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.799354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.799842] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 932f8448-cb0e-4854-9e80-520a0b55ce51 is going to be updated. [ 798.801339] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.801501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832115] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.832858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932f8448-cb0e-4854-9e80-520a0b55ce51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.869145] env[69350]: INFO networking_nsxv3.common.synchronization [req-77d32d0e-eb9b-4776-a4ce-ef2542c52469 req-cbc553e7-472c-402d-b485-5f1b32182cba service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 798.869340] env[69350]: INFO networking_nsxv3.common.synchronization [req-77d32d0e-eb9b-4776-a4ce-ef2542c52469 req-cbc553e7-472c-402d-b485-5f1b32182cba service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 798.869482] env[69350]: INFO networking_nsxv3.common.synchronization [req-77d32d0e-eb9b-4776-a4ce-ef2542c52469 req-cbc553e7-472c-402d-b485-5f1b32182cba service nova] Enqueued Resource ID: faee5bfa-fa04-41f9-9b97-0bbab151af2a with Priority: HIGHEST for action port [ 798.869877] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 798.869935] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 798.869991] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee5bfa-fa04-41f9-9b97-0bbab151af2a with Priority: HIGHEST for action port [ 798.870672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.870807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.870807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.871882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.871882] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.873486] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.873604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.873660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.873832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.873982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.874100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.874154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.874304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.874387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.874475] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.875247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-faee5bfa-fa04-41f9-9b97-0bbab151af2a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.875375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.875688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.875688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.875688] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faee5bfa-fa04-41f9-9b97-0bbab151af2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.380047] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.380255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.380562] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.381771] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faee5bfa-fa04-41f9-9b97-0bbab151af2a with status ACTIVE [ 799.382073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.382251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.382356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.382655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.382802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383107] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.383229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.383333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.383577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.383708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.384163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.384268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.384490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.384618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.384760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faee5bfa-fa04-41f9-9b97-0bbab151af2a is going to be updated. [ 799.409364] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.409824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.409977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.410317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.410540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.410903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faee5bfa-fa04-41f9-9b97-0bbab151af2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.887198] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.187084] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 800.187353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.187954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.188229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.188429] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.188557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.188693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.188782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.188867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.188970] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.390312] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.390312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.390312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.390312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.390312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.390312] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be created. [ 800.419783] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.419989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.419989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.420213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.420415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.431589] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: UNINITIALIZED for 2s [ 800.691295] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.194043] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.696756] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.696756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.696756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.696756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.696992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.696992] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 801.728460] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.728685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.728685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.728889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.729041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.738405] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 801.848844] env[69350]: INFO networking_nsxv3.common.synchronization [req-531ca511-b016-4e56-a86b-010722e2e5d3 req-75f2e150-011d-4bcb-b318-f3b949aebe53 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 801.849497] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 801.849966] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.850119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.850189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.850394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.850586] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.850674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.850741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.850894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.850980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.851089] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.182659] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.182875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.183086] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.183342] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.183603] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.183763] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.184740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.184740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.184740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.184740] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.184740] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.184740] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.185285] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.185285] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.185285] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.185285] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.208139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.208425] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 802.208461] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.208638] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-809" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.208947] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.209134] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.209248] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.209605] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.209860] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf4bb5a-e078-48f2-89ea-8914c5c15f10',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.353514] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.442593] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 802.443476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.443855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.444118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.444420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.444577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.444648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.444829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.444964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.445023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.445210] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.716020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716020] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port bcf4bb5a-e078-48f2-89ea-8914c5c15f10 not found, creating... [ 802.716020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.716020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716429] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.716429] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.716429] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.716949] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.717341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.717656] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 is going to be created. [ 802.741376] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.741376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.741376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.741376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.741376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.741376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.856795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.951022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.951022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.951022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.951022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.951022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.951022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.951578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.951578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.951578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.951578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.951578] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.951808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.951808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.951808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.951942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.954971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.954971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.954971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.954971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.954971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.954971] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.360181] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.360587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.360587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.360724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.360845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.360997] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 803.397687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.397687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.397687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.398203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.398203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.418146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 803.455720] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bcf01dc-147d-49bc-839a-137d73c85e2d: rpc.has_security_group_logging(os_id): False [ 803.478942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.479151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.479221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.479467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.479601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.479793] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.479911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.479972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.480147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.480229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.480456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.480569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.480631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.480816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.480900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.481114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.481274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.481274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.481410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.481481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.481546] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be created. [ 803.541983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.541983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.541983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.541983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.541983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.555037] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 803.748681] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 803.748906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.749101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.749311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.749497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.749627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.749699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.749874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.749935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750908] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.827973] env[69350]: INFO networking_nsxv3.common.synchronization [None req-681d8401-027c-46bd-8f1a-e73c56ef45d0 tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 with Priority: HIGHEST for action security_group_rules [ 803.828526] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 with Priority: HIGHEST for action security_group_rules [ 803.829468] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.829468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.829468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.830332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.830332] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.006647] env[69350]: INFO networking_nsxv3.common.synchronization [req-531ca511-b016-4e56-a86b-010722e2e5d3 req-2f7a3ea8-b9bd-4073-9d06-fa9ac60f89db service nova] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 804.007384] env[69350]: INFO networking_nsxv3.common.synchronization [req-531ca511-b016-4e56-a86b-010722e2e5d3 req-2f7a3ea8-b9bd-4073-9d06-fa9ac60f89db service nova] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 804.007621] env[69350]: INFO networking_nsxv3.common.synchronization [req-531ca511-b016-4e56-a86b-010722e2e5d3 req-2f7a3ea8-b9bd-4073-9d06-fa9ac60f89db service nova] Enqueued Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 804.008241] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 804.008453] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 804.008667] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 804.009074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.009718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.009845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.010172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.010354] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.012105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.012105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.012417] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.012580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.012686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.012972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.013153] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf4bb5a-e078-48f2-89ea-8914c5c15f10',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.196499] env[69350]: INFO networking_nsxv3.common.synchronization [None req-74d8f213-9887-4811-998a-fe24559ec065 tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 with Priority: HIGHEST for action security_group_rules [ 804.196499] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 with Priority: HIGHEST for action security_group_rules [ 804.196499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.196499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.257021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.257021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.257021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.257021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.257021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.257968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.257968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.257968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.257968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.257968] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.356615] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.361025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 already deleted. [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.361025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.361025] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.512627] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.512762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.516209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with status ACTIVE [ 804.516343] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.516468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.516533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.516743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.516827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.516988] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.517103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.517163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.517308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.517379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.517550] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.517636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.517692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.517823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.517891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.517968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 is going to be updated. [ 804.540312] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.540632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.540722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.540941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.541152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.541413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.624271] env[69350]: INFO networking_nsxv3.common.synchronization [req-fc0bae6d-3dfe-4eb8-89e1-05344eb61c54 req-495df033-9fa2-42b8-a5ba-bbfc2ce0e508 tempest-ServerAddressesTestJSON-1397294373 tempest-ServerAddressesTestJSON-1397294373-project-member] Enqueued Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 804.624721] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 804.625034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.625202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.625278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.626798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.627706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.627834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.628354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.628570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.628684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.628937] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.764552] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a07d8013-92b1-46a1-acb2-34b3df1ac235: rpc.has_security_group_logging(os_id): False [ 804.781544] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.781783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.781842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.782398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.783216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.783449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.783563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.783631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.783806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.783888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786330] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.787120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.787184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.787345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.787431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.787538] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 804.854740] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.855042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.855042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.855355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.855788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.877189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 804.881581] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.881723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.881800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.882056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.882147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.882243] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6 already deleted. [ 804.882323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaec8b2b-e2ee-4a90-ae60-ee946ac7f8c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.133280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.133280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.133280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb already deleted. [ 805.133280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.431035] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 805.431302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.431461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.431684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.431862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.431980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.432087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.432248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.432343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.432441] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.568909] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 805.569172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.656917] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.657186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-665" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.657244] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-665" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.657621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-665" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.657886] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.658216] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.658377] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.658602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.659023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.659023] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.659184] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.659184] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.660098] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.660098] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.660098] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.660098] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.679675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.679843] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.680066] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.680257] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-665" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.680647] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-0bc88d0d-77da-4f99-827c-fe88dc1a6396 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.681207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.681207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.681369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.681590] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bc88d0d-77da-4f99-827c-fe88dc1a6396',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.934672] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.185673] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.186015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.186091] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.186535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.186535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.186742] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 0bc88d0d-77da-4f99-827c-fe88dc1a6396 not found, creating... [ 806.186959] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.188018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.188018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.188018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.188018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.188018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.188376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.188514] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.188652] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 0bc88d0d-77da-4f99-827c-fe88dc1a6396 is going to be created. [ 806.208144] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.208369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.208542] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.208859] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.209135] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.209367] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.438331] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.894510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 806.894510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.943151] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.943151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.943151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.943151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.943151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.943151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 806.975234] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.976253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.977337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.977689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.977872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.993673] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 807.703349] env[69350]: INFO networking_nsxv3.common.synchronization [req-fc0bae6d-3dfe-4eb8-89e1-05344eb61c54 req-86961842-7912-49b2-82a3-0a02ccf9af91 service nova] Enqueued Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_rules [ 807.703672] env[69350]: INFO networking_nsxv3.common.synchronization [req-fc0bae6d-3dfe-4eb8-89e1-05344eb61c54 req-86961842-7912-49b2-82a3-0a02ccf9af91 service nova] Enqueued Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 807.703672] env[69350]: INFO networking_nsxv3.common.synchronization [req-fc0bae6d-3dfe-4eb8-89e1-05344eb61c54 req-86961842-7912-49b2-82a3-0a02ccf9af91 service nova] Enqueued Resource ID: 0bc88d0d-77da-4f99-827c-fe88dc1a6396 with Priority: HIGHEST for action port [ 807.703937] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_rules [ 807.704092] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 807.704193] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc88d0d-77da-4f99-827c-fe88dc1a6396 with Priority: HIGHEST for action port [ 807.704824] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.704974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.706638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.706811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.706848] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.708542] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.708752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.708752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.709102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.709360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.709471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.709680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.709972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.710267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.710445] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.711963] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bc88d0d-77da-4f99-827c-fe88dc1a6396 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.712109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.712210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.715659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.715659] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bc88d0d-77da-4f99-827c-fe88dc1a6396',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.966389] env[69350]: INFO networking_nsxv3.common.synchronization [req-475b3f30-b615-4b88-bac3-f9a502f06079 req-6ba39d0a-6488-463f-9c5f-2d7d631f4de4 tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 807.966389] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 807.966389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.966389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.966389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.966389] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.216726] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.216726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.216726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.216726] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bc88d0d-77da-4f99-827c-fe88dc1a6396 with status ACTIVE [ 808.216726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.216726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.216726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.216726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.216726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.217712] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.217712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.217712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.217712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.218506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.218506] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.218651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.218790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.219046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.219150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.219321] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bc88d0d-77da-4f99-827c-fe88dc1a6396 is going to be updated. [ 808.250104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.250104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.250104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.250104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.250104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.250104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bc88d0d-77da-4f99-827c-fe88dc1a6396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.468697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.469823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.470074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.470435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.471196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.471558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.471848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.472085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.472399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.472612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.472824] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 808.505256] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.505256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.505256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.505256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.505256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.516518] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 808.611743] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.612423] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.613214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.613214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.614365] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.614761] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.615048] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.618024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.618024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.618024] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.618024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.618024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.618024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.618024] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.618024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.618024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.644487] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.644487] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 808.647178] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.647178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-126" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.647178] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6ae6ed9a-0ff1-4853-b37e-44aba5240640 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.647178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.647178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.647178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.647178] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae6ed9a-0ff1-4853-b37e-44aba5240640',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.717596] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.004154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 809.004408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.004634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.004862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.005094] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.005251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.005466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.005737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.005785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.005876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.006035] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.153026] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.153256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.153440] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.153729] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.153862] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.154015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6ae6ed9a-0ff1-4853-b37e-44aba5240640 not found, creating... [ 809.154300] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.154461] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.154578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.154793] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.154930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.155242] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.155401] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.155518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.155905] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.155905] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.157564] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6ae6ed9a-0ff1-4853-b37e-44aba5240640 is going to be created. [ 809.161917] env[69350]: INFO networking_nsxv3.common.synchronization [None req-21fef226-f131-4e00-8778-35e13ab12473 None None] Enqueued Resource ID: af80ba71-281a-4bcf-9ab0-82d60abdb69b with Priority: HIGHEST for action port [ 809.162146] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af80ba71-281a-4bcf-9ab0-82d60abdb69b with Priority: HIGHEST for action port [ 809.162724] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-af80ba71-281a-4bcf-9ab0-82d60abdb69b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.163507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af80ba71-281a-4bcf-9ab0-82d60abdb69b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.163507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af80ba71-281a-4bcf-9ab0-82d60abdb69b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.163507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af80ba71-281a-4bcf-9ab0-82d60abdb69b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.163507] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af80ba71-281a-4bcf-9ab0-82d60abdb69b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.181044] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.181279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.181410] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.181724] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.181955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.182517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.220355] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.220490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.220490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.220708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.220899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.220980] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb is going to be created. [ 809.262543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.262543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.262543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.262543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.262543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.300489] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: UNINITIALIZED for 2s [ 809.508844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.509168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.509425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.509736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.509938] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.510345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.510345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.510345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.510345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.511847] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.511847] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.511847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.511847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.632590] env[69350]: INFO networking_nsxv3.common.synchronization [None req-68171d3a-443f-45a6-9cf9-00f138829f68 None None] Enqueued Resource ID: 1056eff3-708e-44c5-8741-56edc0edff20 with Priority: HIGHEST for action port [ 809.634734] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1056eff3-708e-44c5-8741-56edc0edff20 with Priority: HIGHEST for action port [ 809.635311] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1056eff3-708e-44c5-8741-56edc0edff20 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.635311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1056eff3-708e-44c5-8741-56edc0edff20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.635563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1056eff3-708e-44c5-8741-56edc0edff20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.638932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1056eff3-708e-44c5-8741-56edc0edff20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.638932] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1056eff3-708e-44c5-8741-56edc0edff20',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.666080] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af80ba71-281a-4bcf-9ab0-82d60abdb69b [ 809.666312] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.666442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.666506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.666721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.666806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.666895] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af80ba71-281a-4bcf-9ab0-82d60abdb69b already deleted. [ 809.666971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af80ba71-281a-4bcf-9ab0-82d60abdb69b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.020436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 810.041809] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.043839] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.043839] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.043839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.044390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.044390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.044390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.044390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.044390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.044549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.044579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.044789] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 810.128920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.129169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.129169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.129358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.129505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.137605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1056eff3-708e-44c5-8741-56edc0edff20 [ 810.137978] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.138135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.138205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.138423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.138516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.138612] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1056eff3-708e-44c5-8741-56edc0edff20 already deleted. [ 810.138693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1056eff3-708e-44c5-8741-56edc0edff20" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.147763] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 810.526722] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 810.527072] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a deletion is rescheduled due to dependency. [ 810.527314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [req-475b3f30-b615-4b88-bac3-f9a502f06079 req-fcc76ee0-3e99-48b9-89d3-4b792fb5e93c service nova] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [req-475b3f30-b615-4b88-bac3-f9a502f06079 req-fcc76ee0-3e99-48b9-89d3-4b792fb5e93c service nova] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [req-475b3f30-b615-4b88-bac3-f9a502f06079 req-fcc76ee0-3e99-48b9-89d3-4b792fb5e93c service nova] Enqueued Resource ID: 6ae6ed9a-0ff1-4853-b37e-44aba5240640 with Priority: HIGHEST for action port [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_rules [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 811.139265] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae6ed9a-0ff1-4853-b37e-44aba5240640 with Priority: HIGHEST for action port [ 811.140747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.141149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.142928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.142928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.142928] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.145132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.145132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.145132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.145132] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.146480] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae6ed9a-0ff1-4853-b37e-44aba5240640 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.146787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.147753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.147753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.147753] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae6ed9a-0ff1-4853-b37e-44aba5240640',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.175024] env[69350]: INFO networking_nsxv3.common.synchronization [req-46f5f8bd-253a-4193-91eb-b666831cafec req-a1a6aa30-a5e8-45c4-91b1-33091d746df3 tempest-ServerRescueTestJSON-370583535 tempest-ServerRescueTestJSON-370583535-project-member] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 811.175024] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 811.175024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.175024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.180232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.180851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.181014] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.181138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.181239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.181456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.182464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.182578] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.316030] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: SUCCESS [ 811.316347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.316783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.317149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.318020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.318020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.318020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.319160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.319282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.319449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.319510] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.651993] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.652158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.652368] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.653296] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ae6ed9a-0ff1-4853-b37e-44aba5240640 with status ACTIVE [ 811.653490] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.653675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.653675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.653878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.653976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.654161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.654270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.654490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.654569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.654751] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.654843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.654901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.660064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.660064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.660064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ae6ed9a-0ff1-4853-b37e-44aba5240640 is going to be updated. [ 811.688105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.688105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.688105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.688105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.688105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.688635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae6ed9a-0ff1-4853-b37e-44aba5240640" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.688635] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.823838] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.823838] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824329] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.824470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.824564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.824797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824991] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.825151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.825238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.825452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.825574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.825705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.825853] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.889141] env[69350]: INFO networking_nsxv3.common.synchronization [None req-fa7bb13f-1875-43da-9454-fea90d024c6c None None] Enqueued Resource ID: e0955560-6258-4662-8c85-1db29297d396 with Priority: HIGHEST for action port [ 811.889422] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0955560-6258-4662-8c85-1db29297d396 with Priority: HIGHEST for action port [ 811.890161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0955560-6258-4662-8c85-1db29297d396 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.890292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0955560-6258-4662-8c85-1db29297d396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.890358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0955560-6258-4662-8c85-1db29297d396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.890706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0955560-6258-4662-8c85-1db29297d396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.890706] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0955560-6258-4662-8c85-1db29297d396',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.161090] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.167445] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 812.167575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.191178] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.210278] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6c555661-6ed2-4fc1-8c4f-f2c4cfed6559 None None] Enqueued Resource ID: 6403e5ed-12d0-4614-ae00-14b89d281595 with Priority: HIGHEST for action port [ 812.211028] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6403e5ed-12d0-4614-ae00-14b89d281595 with Priority: HIGHEST for action port [ 812.211265] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6403e5ed-12d0-4614-ae00-14b89d281595 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.211354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6403e5ed-12d0-4614-ae00-14b89d281595" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.211392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6403e5ed-12d0-4614-ae00-14b89d281595" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.211658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6403e5ed-12d0-4614-ae00-14b89d281595" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.211750] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6403e5ed-12d0-4614-ae00-14b89d281595',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.330280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 678660c3-42cf-45d8-b53c-95af67caaefb: rpc.has_security_group_logging(os_id): False [ 812.334587] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.334587] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.334587] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.334877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.335322] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.336060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.336060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.336060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.336724] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.337142] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.337397] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.337607] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.337975] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.338257] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.338460] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.338685] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.360972] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.360972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.360972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.361191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.361282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.361529] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.361638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.361709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.361888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.361967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.362817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.362984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.363115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.363417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.363469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.363637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.363753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.363851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.364149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.364253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.364307] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb is going to be created. [ 812.371025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.371025] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.371025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.371025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-291" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.371025] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5e7ef2e1-e76e-455e-8c05-3a75625a2039 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.371025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.371025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.371025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.371025] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e7ef2e1-e76e-455e-8c05-3a75625a2039',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.394601] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0955560-6258-4662-8c85-1db29297d396 [ 812.394906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.395067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.395138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.395440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.395489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.395613] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0955560-6258-4662-8c85-1db29297d396 already deleted. [ 812.395703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0955560-6258-4662-8c85-1db29297d396" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.449420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.450154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.450154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.450280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.454020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.464609] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: IN_PROGRESS for 2s [ 812.663664] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.663822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.663901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.664146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.665150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.665150] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 812.693859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.694040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.694115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.694331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.694423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.694525] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be updated. [ 812.697085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.697211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.697284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.697478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.697620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.718514] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 812.718751] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6403e5ed-12d0-4614-ae00-14b89d281595 [ 812.718951] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.719144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.719235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.723185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.723185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.723185] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6403e5ed-12d0-4614-ae00-14b89d281595 already deleted. [ 812.723185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6403e5ed-12d0-4614-ae00-14b89d281595" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.734263] env[69350]: INFO networking_nsxv3.common.synchronization [req-ec1e0033-2f43-44a2-b363-6784c337cb87 req-7df3dcbe-c2b3-4ce1-a125-b038d96a1517 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 812.734810] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 812.735174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.735296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.735373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.736770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.736770] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.736770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.736770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.736770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.736770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.736770] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.741471] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.741734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.741734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.741929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.741986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.756163] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 812.876365] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.876365] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5e7ef2e1-e76e-455e-8c05-3a75625a2039 not found, creating... [ 812.876365] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.876365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.876768] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.877963] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.878950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.879338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.881334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5e7ef2e1-e76e-455e-8c05-3a75625a2039 is going to be created. [ 812.915182] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.915182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.915182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.915182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.915182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.915182] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.238943] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.239339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.239339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.239492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.239640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.239919] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.240054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.240147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.240353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.240462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.240624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 813.303102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.303257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.303328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.303546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.303726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.320346] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 814.336225] env[69350]: INFO networking_nsxv3.common.synchronization [req-46f5f8bd-253a-4193-91eb-b666831cafec req-64077148-cc5b-494c-8179-b8e0e84d544b service nova] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_rules [ 814.336225] env[69350]: INFO networking_nsxv3.common.synchronization [req-46f5f8bd-253a-4193-91eb-b666831cafec req-64077148-cc5b-494c-8179-b8e0e84d544b service nova] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 814.336635] env[69350]: INFO networking_nsxv3.common.synchronization [req-46f5f8bd-253a-4193-91eb-b666831cafec req-64077148-cc5b-494c-8179-b8e0e84d544b service nova] Enqueued Resource ID: 5e7ef2e1-e76e-455e-8c05-3a75625a2039 with Priority: HIGHEST for action port [ 814.337141] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_rules [ 814.337333] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 814.337510] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7ef2e1-e76e-455e-8c05-3a75625a2039 with Priority: HIGHEST for action port [ 814.340029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.340233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.340760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.340760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.340760] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.342641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.342756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.342989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e7ef2e1-e76e-455e-8c05-3a75625a2039 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.343106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.343178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.343380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.343935] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e7ef2e1-e76e-455e-8c05-3a75625a2039',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.371461] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b9d22a67-c34f-4a3a-a379-c27a42a896d9 None None] Enqueued Resource ID: 2b2854c2-740c-495e-8605-f7ac06c43b68 with Priority: HIGHEST for action port [ 814.372357] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2854c2-740c-495e-8605-f7ac06c43b68 with Priority: HIGHEST for action port [ 814.372819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b2854c2-740c-495e-8605-f7ac06c43b68 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.372926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b2854c2-740c-495e-8605-f7ac06c43b68" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.372980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b2854c2-740c-495e-8605-f7ac06c43b68" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.373372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b2854c2-740c-495e-8605-f7ac06c43b68" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.373438] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2854c2-740c-495e-8605-f7ac06c43b68',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.479257] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: SUCCESS [ 814.479455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.642148] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 814.642148] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 814.642148] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 814.642148] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 814.642148] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.642998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.643089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.643360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.643525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.643630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.643691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.643853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.643931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.644066] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.645071] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.645071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.645071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.645299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.645374] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.645859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.645859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.645859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.645859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.645859] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.661410] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e06775a-1e1c-41ee-a2de-823e58f568b6 req-3be75765-b4f8-4003-af72-82fa8aed02fa tempest-InstanceActionsTestJSON-1427027765 tempest-InstanceActionsTestJSON-1427027765-project-member] Enqueued Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 814.661615] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 814.661928] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.662742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.662742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.662742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.662742] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.663158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.663158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.663470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.663640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.663744] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.729969] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 814.729969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.730125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.730327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.730521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.730643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.730713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.730897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.730998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.731101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.731213] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.744766] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 814.744766] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 814.744766] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_rules [ 814.744766] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 814.744766] env[69350]: INFO networking_nsxv3.common.synchronization [req-097abd51-dddb-43d5-afd8-0bb12e2f6541 req-4b055140-864a-47c2-b272-c9af6266dcf3 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 814.744989] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 814.746764] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_rules [ 814.747053] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 814.748219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 814.748219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 814.748219] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.748219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.748219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.748219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.748219] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.749977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.749977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.749977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.749977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.750292] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.751725] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.751725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.751725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.751725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.751725] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf4bb5a-e078-48f2-89ea-8914c5c15f10',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.752534] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.752665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.752839] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.752925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.768276] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 814.768592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.769129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.769522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.769599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.769827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.769907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.770107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.770215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.770330] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.770657] env[69350]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 814.844897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.844897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.847750] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e7ef2e1-e76e-455e-8c05-3a75625a2039 with status ACTIVE [ 814.851695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.851843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.851987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.854338] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.854338] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.854338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.855551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.855551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.855551] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e7ef2e1-e76e-455e-8c05-3a75625a2039 is going to be updated. [ 814.881539] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b2854c2-740c-495e-8605-f7ac06c43b68 [ 814.881539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.881539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.881539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.881539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.881539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.882919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b2854c2-740c-495e-8605-f7ac06c43b68 already deleted. [ 814.883066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b2854c2-740c-495e-8605-f7ac06c43b68" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.889665] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.889851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.889911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.890137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.890319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.890513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e7ef2e1-e76e-455e-8c05-3a75625a2039" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.149206] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.153657] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.166369] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.166369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.166369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.166369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.166711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.166711] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.167137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.167137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.167137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.167137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.167386] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d already deleted. [ 815.167386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.233996] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.255181] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.255349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.256055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.256055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.256055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with status ACTIVE [ 815.256055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.257479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.257479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.257654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.257800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.257990] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.258124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.258190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.259176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.259273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.259497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.259659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.259780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.259964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.260065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.260158] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 is going to be updated. [ 815.274556] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.302462] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.302723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.302723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.302954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.303094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.303254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.334306] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 815.334605] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d deletion is rescheduled due to dependency. [ 815.334778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.567258] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.567556] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.567618] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.567954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.568247] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.568401] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.568530] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.568805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.568902] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.569120] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.569273] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.569346] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.569436] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.569838] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.569907] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.570060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.602383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.602383] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.602383] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.602383] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.602608] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-feb79de1-f6f9-4d62-8783-434587da29fd taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.602753] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.602962] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.603545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.603719] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feb79de1-f6f9-4d62-8783-434587da29fd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.651964] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.658206] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.736218] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518254d1-d440-4d15-b32d-8975c834377a: rpc.has_security_group_logging(os_id): False [ 815.764207] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.765388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.765388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.765686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.765686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.765744] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 815.776689] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.850607] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.850607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.850607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.850607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.850607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.869776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 816.106786] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.107123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.107289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.107667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.107867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.108059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port feb79de1-f6f9-4d62-8783-434587da29fd not found, creating... [ 816.108388] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.108581] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.108756] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.109015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.109683] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.110740] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.111440] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.111527] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.114994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.114994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.114994] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: feb79de1-f6f9-4d62-8783-434587da29fd is going to be created. [ 816.139025] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.139294] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.140129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.140269] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.140561] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.140865] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.157750] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.157750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.157750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.157750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.157750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.157750] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be created. [ 816.162212] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.162212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.162212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.162212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.162212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.162212] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 816.186362] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.186362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.186362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.201391] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.201391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.201391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.201391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.201391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.204624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: UNINITIALIZED for 2s [ 816.216810] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 816.282773] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.282773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.282773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.282773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.282773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.282773] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be updated. [ 816.337551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.341209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.341209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.341209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.341209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.352172] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 816.510151] env[69350]: INFO networking_nsxv3.common.synchronization [None req-75229fa4-1963-4533-bca8-98a8001abdd2 None None] Enqueued Resource ID: 27e98537-c61f-46f8-a60e-cda699c2e811 with Priority: HIGHEST for action port [ 816.510758] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27e98537-c61f-46f8-a60e-cda699c2e811 with Priority: HIGHEST for action port [ 816.511092] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-27e98537-c61f-46f8-a60e-cda699c2e811 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.511216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27e98537-c61f-46f8-a60e-cda699c2e811" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.511299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27e98537-c61f-46f8-a60e-cda699c2e811" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.512756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27e98537-c61f-46f8-a60e-cda699c2e811" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.512847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e98537-c61f-46f8-a60e-cda699c2e811',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.935973] env[69350]: INFO networking_nsxv3.common.synchronization [req-3e737021-d14e-42a3-a9b8-9f252f181a26 req-10c10768-6cb5-48fd-9393-bd546dcbc8ba tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 816.936228] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGHEST for action security_group_members [ 816.937445] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.937445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.937445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.937445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.937445] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.937445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.937445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.938472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.938472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.938472] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.016316] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27e98537-c61f-46f8-a60e-cda699c2e811 [ 817.016571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.016709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.016781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.017014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.017795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.017795] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27e98537-c61f-46f8-a60e-cda699c2e811 already deleted. [ 817.017795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27e98537-c61f-46f8-a60e-cda699c2e811" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.146244] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e06775a-1e1c-41ee-a2de-823e58f568b6 req-af6edde4-1e9d-4701-b119-145c0df9c2d4 service nova] Enqueued Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_rules [ 817.146244] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e06775a-1e1c-41ee-a2de-823e58f568b6 req-af6edde4-1e9d-4701-b119-145c0df9c2d4 service nova] Enqueued Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 817.146244] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e06775a-1e1c-41ee-a2de-823e58f568b6 req-af6edde4-1e9d-4701-b119-145c0df9c2d4 service nova] Enqueued Resource ID: feb79de1-f6f9-4d62-8783-434587da29fd with Priority: HIGHEST for action port [ 817.146462] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_rules [ 817.146888] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 817.147121] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feb79de1-f6f9-4d62-8783-434587da29fd with Priority: HIGHEST for action port [ 817.148063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.148748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.148899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.149248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.149556] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.151034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.151931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.152017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.152235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.152703] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.152703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.152703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.152924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.152924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.152924] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.154856] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-feb79de1-f6f9-4d62-8783-434587da29fd taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.154856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.154856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.154856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.154856] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feb79de1-f6f9-4d62-8783-434587da29fd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.441686] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.441686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.441686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.441686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.441686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.441984] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.442047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.442092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.442255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.446032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.446032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 is going to be updated. [ 817.478450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.478612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.478652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.478860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.478997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.491944] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: IN_PROGRESS for 2s [ 817.656821] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feb79de1-f6f9-4d62-8783-434587da29fd with status ACTIVE [ 817.657637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.657856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.657967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.658230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.658674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.658934] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.659237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.659355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.659800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.659800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.660065] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.660218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.660400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.660662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.660789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.661064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feb79de1-f6f9-4d62-8783-434587da29fd is going to be updated. [ 817.663080] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.665129] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.665396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.689064] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.690249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.690249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.690249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feb79de1-f6f9-4d62-8783-434587da29fd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.746872] env[69350]: INFO networking_nsxv3.common.synchronization [None req-95639789-aacb-4eff-b174-bb821ab48d75 None None] Enqueued Resource ID: 8589f169-6f59-488d-b4bf-4cb55ad58f95 with Priority: HIGHEST for action port [ 817.747166] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8589f169-6f59-488d-b4bf-4cb55ad58f95 with Priority: HIGHEST for action port [ 817.747906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8589f169-6f59-488d-b4bf-4cb55ad58f95 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.747906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8589f169-6f59-488d-b4bf-4cb55ad58f95" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.748036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8589f169-6f59-488d-b4bf-4cb55ad58f95" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.748209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8589f169-6f59-488d-b4bf-4cb55ad58f95" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.748291] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8589f169-6f59-488d-b4bf-4cb55ad58f95',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.891145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 817.891831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.167466] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.226792] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 818.226792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.230682] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.230682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.230682] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.230682] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 818.231100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.231636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.231985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.232200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.232453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.232611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.232820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.232965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.233392] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.257586] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8589f169-6f59-488d-b4bf-4cb55ad58f95 [ 818.257586] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.257586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.257586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.257586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.257586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.257586] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8589f169-6f59-488d-b4bf-4cb55ad58f95 already deleted. [ 818.257586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8589f169-6f59-488d-b4bf-4cb55ad58f95" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.373921] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 818.374831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.374831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.374831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.375251] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.375376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.375442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.375634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.375765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.375862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.375990] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.669495] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.669791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.669861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.670199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.670369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.670528] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d is going to be created. [ 818.696057] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.696344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.696934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.696934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.697066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.712027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: UNINITIALIZED for 2s [ 818.735260] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.736922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.878998] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.879208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.879290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.879679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.879949] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.880068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.880160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.880340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.880431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.880521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.880698] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.880838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.880920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.881139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.881284] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.881373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.881429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.881976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.881976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.881976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.881976] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.239655] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.241745] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.387675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdbb2071-5801-4662-9a75-aa174ebd2139: rpc.has_security_group_logging(os_id): False [ 819.411235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.411235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.411235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.411235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.414809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.415018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.415386] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.415498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.415567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.415761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.415823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.416132] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be updated. [ 819.507431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01249833-e649-48c7-b9c6-9d9107bdff51 in Status: SUCCESS [ 819.507852] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 deletion is rescheduled due to dependency. [ 819.507852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.509080] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.509220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.509294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.509504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.529929] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 819.747314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.747314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.747314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.750614] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be updated. [ 819.750614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.750614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.750614] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 819.789442] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.789597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.789695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.789994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.790335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.792611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.792771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.792823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.793065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.793287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.811742] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 819.812688] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 820.720496] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: SUCCESS [ 820.720909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.720909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.721181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.721388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.721512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.721583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.722058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.722238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.722328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.722444] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.022272] env[69350]: INFO networking_nsxv3.common.synchronization [req-be71bfff-e7b9-4a4b-99ba-7b4d0e89e64d req-b35f7b4b-34ba-41ad-81e4-afc7e746b7e4 tempest-ServerAddressesTestJSON-1397294373 tempest-ServerAddressesTestJSON-1397294373-project-member] Enqueued Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 821.023619] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGHEST for action security_group_members [ 821.023619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.023619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.023619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.024550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.024873] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.024930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.025250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.025250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.025335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.025379] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.073340] env[69350]: INFO networking_nsxv3.common.synchronization [None req-efcb1a32-6c47-46a9-9597-628b870b91ac None None] Enqueued Resource ID: 89c719a7-ac8c-4aba-a4df-e94647769358 with Priority: HIGHEST for action port [ 821.073888] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89c719a7-ac8c-4aba-a4df-e94647769358 with Priority: HIGHEST for action port [ 821.074406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-89c719a7-ac8c-4aba-a4df-e94647769358 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.074523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89c719a7-ac8c-4aba-a4df-e94647769358" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.074590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89c719a7-ac8c-4aba-a4df-e94647769358" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.074836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89c719a7-ac8c-4aba-a4df-e94647769358" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.074920] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c719a7-ac8c-4aba-a4df-e94647769358',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.224374] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.224455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.224492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.224818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.225093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.225093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.225093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.225706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.225706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.225706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.225706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.225706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.225706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.226577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.226577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.226577] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.530235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.530235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.530235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.530235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.530235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.530628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.530628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.530628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.530741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.531705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.531705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb is going to be updated. [ 821.548878] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 821.548878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.562668] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.562827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.562900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.563222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.563382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.575950] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: IN_PROGRESS for 2s [ 821.577792] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89c719a7-ac8c-4aba-a4df-e94647769358 [ 821.577792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.578284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.579028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.579028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.579028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.579028] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89c719a7-ac8c-4aba-a4df-e94647769358 already deleted. [ 821.579028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89c719a7-ac8c-4aba-a4df-e94647769358" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.730723] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1482b722-72ef-4020-8a3f-101a71d9d71d: rpc.has_security_group_logging(os_id): False [ 821.759731] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.760282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.764667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.764667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.764667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.765385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.765385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.765385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.765385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.765605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.765679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.765679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.765961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.766065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.766155] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d is going to be created. [ 821.827027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 821.827267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.827501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.827886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.828095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.828224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.828363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.828489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.828619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.828727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.828828] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.840628] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 821.840917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.841133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.841381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.841578] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.842196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.842196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.842196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.842196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.842196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.842196] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.850116] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.850295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.850385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.850596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.850863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.869908] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: IN_PROGRESS for 2s [ 822.331663] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.348718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.348982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.348982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.349213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.349406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.349500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.349554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.349696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.349782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.349896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.353321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.353321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.353321] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.835564] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c65be464-09bf-460a-92f1-39277c687ead: rpc.has_security_group_logging(os_id): False [ 822.859855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.859855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.859855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.859855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.859855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.860580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.860580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.860580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.860580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.860580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.860580] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be created. [ 822.861606] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 822.880953] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.881056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.881091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.881314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.881408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.881642] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.881840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.881840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.881942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.882031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.882242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.882340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.882402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.882543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.882617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.882794] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.882889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.882951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.883106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.883180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.883266] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 822.922290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.922770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.922896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.926750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.927440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.942887] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 822.985416] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.985416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.985416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.985416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.985416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.039008] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 823.586448] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 678660c3-42cf-45d8-b53c-95af67caaefb in Status: SUCCESS [ 823.586677] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb deletion is rescheduled due to dependency. [ 823.586823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.885114] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: SUCCESS [ 823.885562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 824.880135] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.883371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.883488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.883877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.883877] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.884156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.884156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.884264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.884313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.885060] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.885514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.885758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.885758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.885846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.885985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.886094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.886156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.886299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.886530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.886530] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.889331] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75600c85-b926-497a-8a4e-6f23e1b75c2a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.889442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.889541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.889712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.889899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.893393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.893393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.893393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.893393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.893393] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.961465] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 824.965308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.035972] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_rules [ 825.036260] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 825.036470] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 825.037086] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 825.037086] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_rules [ 825.037086] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 825.037086] env[69350]: INFO networking_nsxv3.common.synchronization [req-ca61aa07-22c9-4fae-8831-1c44d29b5298 req-4a10e0a4-05ef-4b5e-acc1-95432177c9fb tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 825.037615] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_rules [ 825.037769] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_rules [ 825.037848] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 825.037960] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with Priority: HIGHEST for action port [ 825.038050] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_rules [ 825.038153] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 825.038370] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 825.038545] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75600c85-b926-497a-8a4e-6f23e1b75c2a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.038774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.038774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.039025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.039092] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.040181] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.040365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.040593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.040734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.041351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.041473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.041569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.041781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.041869] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf4bb5a-e078-48f2-89ea-8914c5c15f10',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.042738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.042869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.043070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.043198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.044242] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.044242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75600c85-b926-497a-8a4e-6f23e1b75c2a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.044242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.044454] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.044525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.062399] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 825.062769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.063044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.063291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.063400] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.399327] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.401470] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.408713] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6884029-05be-4be7-86b3-55992743bf06 req-08d8b456-6c5f-4220-9599-d80ceafaa080 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 825.408713] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.408713] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 825.408713] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.408713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.408713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.409106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.410219] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.410219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.410219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.410219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.410219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.410219] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.545648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75600c85-b926-497a-8a4e-6f23e1b75c2a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.545732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.546596] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf4bb5a-e078-48f2-89ea-8914c5c15f10 with status ACTIVE [ 825.546596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.546596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.546596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.546596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.546596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.546899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.546899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.546899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.547046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.547046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.547685] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.547685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.547685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.547685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.547685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.547685] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf4bb5a-e078-48f2-89ea-8914c5c15f10 is going to be updated. [ 825.550474] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.550603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.567131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.567730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.571593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.571732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.571825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.572015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.572252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.572409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf4bb5a-e078-48f2-89ea-8914c5c15f10" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.908070] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.911019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.912381] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.914319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.914435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.914474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.914703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.914799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.914978] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.915179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.915179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.915357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.915397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.915522] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 825.946020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.946020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.946020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.946020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.946020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.955426] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 825.962017] env[69350]: INFO networking_nsxv3.common.synchronization [None req-44b9f559-a54e-4dbd-9384-cea43b1fb3e9 None None] Enqueued Resource ID: 91b4c8af-7c7c-4127-818f-e74d7bbecbe7 with Priority: HIGHEST for action port [ 825.962017] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91b4c8af-7c7c-4127-818f-e74d7bbecbe7 with Priority: HIGHEST for action port [ 825.962017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-91b4c8af-7c7c-4127-818f-e74d7bbecbe7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.962017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91b4c8af-7c7c-4127-818f-e74d7bbecbe7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.962017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91b4c8af-7c7c-4127-818f-e74d7bbecbe7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.962017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91b4c8af-7c7c-4127-818f-e74d7bbecbe7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.962017] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91b4c8af-7c7c-4127-818f-e74d7bbecbe7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.182796] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.183074] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.183240] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.183468] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.183732] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.183890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.184017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.188126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.188774] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.188774] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.188774] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.188774] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.188961] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.188999] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.189241] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.189241] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.218960] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.218960] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 826.218960] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.218960] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.218960] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-778c62bd-997b-4337-a1a1-763cfce580ba taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.219174] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.219280] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219757] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('778c62bd-997b-4337-a1a1-763cfce580ba',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.410732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.412102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.412102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.412102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.412102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.412102] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be updated. [ 826.413140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.413670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.413670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.413670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.413670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.413670] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 826.425558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.425796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.425835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.426072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.426175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.426283] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a is going to be created. [ 826.447943] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.448480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.448669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.449009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.449296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.451292] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.451554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.451706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.451987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.452241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.454642] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.454915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.455102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.455638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.455890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.463939] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91b4c8af-7c7c-4127-818f-e74d7bbecbe7 [ 826.464579] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.464918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.465104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.465398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.465783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.466012] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91b4c8af-7c7c-4127-818f-e74d7bbecbe7 already deleted. [ 826.466216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91b4c8af-7c7c-4127-818f-e74d7bbecbe7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467304] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 826.471334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 826.472070] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a in Status: UNINITIALIZED for 2s [ 826.724066] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.724305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.724428] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.724741] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.724892] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.725061] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 778c62bd-997b-4337-a1a1-763cfce580ba not found, creating... [ 826.725318] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.726107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.726107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.726107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.726107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.726314] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.726676] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.726853] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.727093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.727231] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.727372] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 778c62bd-997b-4337-a1a1-763cfce580ba is going to be created. [ 826.769463] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.769463] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.769463] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.769797] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.769797] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.771575] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.748298] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6884029-05be-4be7-86b3-55992743bf06 req-82964ac5-0ccb-4747-b28c-2827e4654db0 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 827.748298] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6884029-05be-4be7-86b3-55992743bf06 req-82964ac5-0ccb-4747-b28c-2827e4654db0 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 827.748727] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6884029-05be-4be7-86b3-55992743bf06 req-82964ac5-0ccb-4747-b28c-2827e4654db0 service nova] Enqueued Resource ID: 778c62bd-997b-4337-a1a1-763cfce580ba with Priority: HIGHEST for action port [ 827.749066] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 827.749189] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 827.749329] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778c62bd-997b-4337-a1a1-763cfce580ba with Priority: HIGHEST for action port [ 827.749995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.749995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.749995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.750232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.750232] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.751085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.751198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.751406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-778c62bd-997b-4337-a1a1-763cfce580ba taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.751519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.751583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.751750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.751823] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('778c62bd-997b-4337-a1a1-763cfce580ba',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.968058] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 827.968309] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 827.968507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.968724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.968968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.969175] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.969311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.969378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.969556] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.969653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.969786] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.254992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.254992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.254992] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 778c62bd-997b-4337-a1a1-763cfce580ba with status ACTIVE [ 828.254992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.254992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.254992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.254992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.255630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.255630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.255630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.255630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.255630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.255782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.256588] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.256588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.256588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.256588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.256588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.256588] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 778c62bd-997b-4337-a1a1-763cfce580ba is going to be updated. [ 828.284563] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.286392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.286627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.286821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.287017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.287244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-778c62bd-997b-4337-a1a1-763cfce580ba" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.413214] env[69350]: INFO networking_nsxv3.common.synchronization [None req-092a5737-fd96-46ac-a298-f27477b71fd5 None None] Enqueued Resource ID: be3520bd-4a5d-466f-96b4-97b22fe46a4f with Priority: HIGHEST for action port [ 828.413214] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3520bd-4a5d-466f-96b4-97b22fe46a4f with Priority: HIGHEST for action port [ 828.413214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-be3520bd-4a5d-466f-96b4-97b22fe46a4f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.413695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be3520bd-4a5d-466f-96b4-97b22fe46a4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.414416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be3520bd-4a5d-466f-96b4-97b22fe46a4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.416770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be3520bd-4a5d-466f-96b4-97b22fe46a4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.416964] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be3520bd-4a5d-466f-96b4-97b22fe46a4f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.472486] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.482581] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 828.482581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.483555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.483941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.484139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.484256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.484319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.484478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.484560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.484652] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.486091] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a in Status: SUCCESS [ 828.486294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.487058] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 828.487246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.487393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.487566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.487732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.487884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.487966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.488132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.488213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.488309] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.489270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.489453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.489609] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.489710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.489790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.490038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.490136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.490228] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.755676] env[69350]: INFO networking_nsxv3.common.synchronization [req-f5302459-f49e-4593-8b50-465010dfb6e5 req-ccfb5b92-d058-437c-b2a5-7e3af892f5da tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 828.755941] env[69350]: INFO networking_nsxv3.common.synchronization [req-f5302459-f49e-4593-8b50-465010dfb6e5 req-ccfb5b92-d058-437c-b2a5-7e3af892f5da tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 828.755995] env[69350]: INFO networking_nsxv3.common.synchronization [req-f5302459-f49e-4593-8b50-465010dfb6e5 req-ccfb5b92-d058-437c-b2a5-7e3af892f5da tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 828.756798] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGHEST for action security_group_members [ 828.756798] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 828.756798] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a with Priority: HIGHEST for action security_group_members [ 828.757561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.757706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.757878] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.757943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.758144] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75600c85-b926-497a-8a4e-6f23e1b75c2a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.758215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.920327] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be3520bd-4a5d-466f-96b4-97b22fe46a4f [ 828.920327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.920327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.920327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.921220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.921220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.921220] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be3520bd-4a5d-466f-96b4-97b22fe46a4f already deleted. [ 828.921220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be3520bd-4a5d-466f-96b4-97b22fe46a4f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.975957] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.991413] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.992258] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.992898] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.478585] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.478767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.478815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.479107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.479208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.479309] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 829.494587] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.495908] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.499178] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.511407] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.511604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.511698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.512278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.512278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.523733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 829.662792] env[69350]: INFO networking_nsxv3.common.synchronization [None req-cd8b8bea-91d9-474b-8e58-79f45408ee41 None None] Enqueued Resource ID: b36dc4cc-459f-43e5-8e0f-955c1b139ce6 with Priority: HIGHEST for action port [ 829.664817] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36dc4cc-459f-43e5-8e0f-955c1b139ce6 with Priority: HIGHEST for action port [ 829.664817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b36dc4cc-459f-43e5-8e0f-955c1b139ce6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.664817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b36dc4cc-459f-43e5-8e0f-955c1b139ce6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.664817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b36dc4cc-459f-43e5-8e0f-955c1b139ce6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.665141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b36dc4cc-459f-43e5-8e0f-955c1b139ce6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.665295] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b36dc4cc-459f-43e5-8e0f-955c1b139ce6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.997710] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.998059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.998190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.998523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.998609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.998712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a is going to be updated. [ 830.000597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.000721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.000948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.002391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.002504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.002607] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be updated. [ 830.003883] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.003985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.003985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.004186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.004233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.004317] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 830.042023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.042023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.042023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.042023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.042023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.046025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.046025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.046025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.060248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 830.061047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a in Status: IN_PROGRESS for 2s [ 830.061812] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 830.171443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b36dc4cc-459f-43e5-8e0f-955c1b139ce6 [ 830.171684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.171831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.171897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.172207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.172405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.172481] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b36dc4cc-459f-43e5-8e0f-955c1b139ce6 already deleted. [ 830.172562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b36dc4cc-459f-43e5-8e0f-955c1b139ce6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.213391] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 830.213391] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:1 started [ 830.626176] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-50966ca4-094e-4946-8024-1aa640546d57 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 830.626638] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 830.626935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.627073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.627139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.627391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.628249] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.628249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.628249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.628249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.628249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.631764] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.139360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.139614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.139652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.140704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.140704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.140704] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.140704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.140704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.140704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.141024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.141024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 already deleted. [ 831.141024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.162684] env[69350]: INFO networking_nsxv3.common.synchronization [None req-319605b7-7328-4455-adec-1ef0b3ae07fd tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 831.163302] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 831.163659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.163816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.163894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.165619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.165712] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.268024] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0275ce94-120e-4d15-b086-39e22d647168 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 831.268586] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 831.268881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.268976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.423784] env[69350]: INFO networking_nsxv3.common.synchronization [req-fee234da-c7b1-42d9-ab11-280275a2b8fd req-a4221038-daf9-4c8e-8d4f-be9dc13b7770 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 831.424241] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 831.424583] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.424705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.424705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.426348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.426348] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.426348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.426348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.426348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.426348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.426348] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.484827] env[69350]: INFO networking_nsxv3.common.synchronization [req-fee234da-c7b1-42d9-ab11-280275a2b8fd req-a4221038-daf9-4c8e-8d4f-be9dc13b7770 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 831.485040] env[69350]: INFO networking_nsxv3.common.synchronization [req-fee234da-c7b1-42d9-ab11-280275a2b8fd req-a4221038-daf9-4c8e-8d4f-be9dc13b7770 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 831.485214] env[69350]: INFO networking_nsxv3.common.synchronization [req-fee234da-c7b1-42d9-ab11-280275a2b8fd req-a4221038-daf9-4c8e-8d4f-be9dc13b7770 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 831.485732] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 831.485867] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 831.485967] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 831.486753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.486985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.486985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.488152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.488152] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.489706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.489706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.489706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d3b49e-ddfa-414c-94e9-df175e925d48 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.490216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.490282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.490513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.490602] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d3b49e-ddfa-414c-94e9-df175e925d48',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.494215] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.494382] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.494627] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.496061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.496061] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.496061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.496061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.496061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.496320] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.496393] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.496504] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.496613] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.496720] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.496828] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.496933] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.497083] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.521303] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.521741] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.524023] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.524023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.524023] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-aa7cd323-5a8a-47a0-a2ff-64375a458c22 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.524023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.524023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.524023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.524023] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa7cd323-5a8a-47a0-a2ff-64375a458c22',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.537480] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.537480] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.537480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.537480] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.688672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.688842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.688896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.689137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.689229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.689328] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 already deleted. [ 831.689399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.689918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.690156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.690265] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.696519] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d9826b76-fd2e-4355-9b88-99228f71c2d8 None None] Enqueued Resource ID: 5a1f07ab-f59a-41e4-a337-907e8b9eec8c with Priority: HIGHEST for action port [ 831.696519] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1f07ab-f59a-41e4-a337-907e8b9eec8c with Priority: HIGHEST for action port [ 831.696519] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a1f07ab-f59a-41e4-a337-907e8b9eec8c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.696519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a1f07ab-f59a-41e4-a337-907e8b9eec8c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.696519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a1f07ab-f59a-41e4-a337-907e8b9eec8c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.696519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a1f07ab-f59a-41e4-a337-907e8b9eec8c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.696519] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a1f07ab-f59a-41e4-a337-907e8b9eec8c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.927958] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.993025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.993025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.994494] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d3b49e-ddfa-414c-94e9-df175e925d48 with status ACTIVE [ 831.994767] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.994907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.994975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.995409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.995409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.995545] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.995626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.995708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.995840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.995915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.996127] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.996250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.996335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.996540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.996625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.996712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 is going to be updated. [ 832.024028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.024234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.024453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.024689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.024884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.025127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.028018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.028380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.028745] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.028952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.029257] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.029680] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port aa7cd323-5a8a-47a0-a2ff-64375a458c22 not found, creating... [ 832.030084] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.030378] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.030378] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.030768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.031120] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.031846] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.031846] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.032116] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.032516] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.032773] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.032977] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: aa7cd323-5a8a-47a0-a2ff-64375a458c22 is going to be created. [ 832.040674] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.040674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.040674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.040674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.040859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.040918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.041595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.041595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.041918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.041918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.041997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.041997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.043858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.043858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.043858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.043858] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.067385] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.068015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.068015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.070826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.071343] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.071548] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.090327] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a in Status: SUCCESS [ 832.090665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.090736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.090987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.091197] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.091318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.091381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.091548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.091633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.091784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.091936] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.093487] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 832.093756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.094603] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 832.094774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.094940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.095162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.095336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.095447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.095514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.095677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.096191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.096191] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.096697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.097332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.098257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.098391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.098438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.098605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.098744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.098779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.102025] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.102025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.102025] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.102696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.102696] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.102696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.102696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.102696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.102874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.102874] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.103693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.103804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.103978] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.104078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.104130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.104820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.104820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.104820] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.199431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a1f07ab-f59a-41e4-a337-907e8b9eec8c [ 832.201124] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.201124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.201124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.201124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.201521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.203777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a1f07ab-f59a-41e4-a337-907e8b9eec8c already deleted. [ 832.203988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a1f07ab-f59a-41e4-a337-907e8b9eec8c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.226466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.226725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.226853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.227199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.227342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.227526] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 already deleted. [ 832.227697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.431728] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.544667] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 832.563442] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.563617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.563685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.563905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.564097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.564327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.564478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.564535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.564649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.564728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.564908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.565143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.565339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.565396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.565439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.565626] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.565721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.565787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.565925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.566014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.566090] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 832.604922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75600c85-b926-497a-8a4e-6f23e1b75c2a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.604922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.604922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.604922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.604922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.604922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.604922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.605223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.605223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.605223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.605365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.605365] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a is going to be deleted. [ 832.610818] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.614123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.614123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.614123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.614123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.614123] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be updated. [ 832.614762] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.629084] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.629250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.629331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.629509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.629658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.642613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.642613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.642613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.642613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.642613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.647452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 832.652754] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.652890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.652960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.653167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.653257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.653356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.655650] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 832.936864] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.936864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.936864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.936864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.936864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.936864] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be updated. [ 832.970084] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.970263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.970353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.970554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.970694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.982079] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: IN_PROGRESS for 2s [ 833.111681] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75600c85-b926-497a-8a4e-6f23e1b75c2a: rpc.has_security_group_logging(os_id): False [ 833.115580] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c65be464-09bf-460a-92f1-39277c687ead: rpc.has_security_group_logging(os_id): False [ 833.116853] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.131382] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.131563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.131637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.131853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.131952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.132343] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.132500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.132679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.132775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.132949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a is going to be created. [ 833.137775] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.137929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.137968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.138794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.138899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.139574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.139650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.139724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.139925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.140042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.140131] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be updated. [ 833.169311] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a], does not exist path=[/infra/domains/default/groups/75600c85-b926-497a-8a4e-6f23e1b75c2a]."\n}' [ 833.169311] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a [ 833.169311] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 833.194049] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-9ccae5dc-7216-4e08-8142-43bb8f576bb7 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 833.194241] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-9ccae5dc-7216-4e08-8142-43bb8f576bb7 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 833.194380] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-9ccae5dc-7216-4e08-8142-43bb8f576bb7 service nova] Enqueued Resource ID: aa7cd323-5a8a-47a0-a2ff-64375a458c22 with Priority: HIGHEST for action port [ 833.194974] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 833.195157] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 833.195257] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cd323-5a8a-47a0-a2ff-64375a458c22 with Priority: HIGHEST for action port [ 833.195546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.195669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.195784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.196017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.196109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.201029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.201029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.201029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.201029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa7cd323-5a8a-47a0-a2ff-64375a458c22 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.201029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.201029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa7cd323-5a8a-47a0-a2ff-64375a458c22',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.239319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.239494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.239572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.241116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.242351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.242733] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.242883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.242968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.245191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.245329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.245659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.245762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.245834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.246052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.246111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.246210] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75600c85-b926-497a-8a4e-6f23e1b75c2a is going to be created. [ 833.261355] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.261549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.261549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.261768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.262323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.269316] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a], does not exist path=[/infra/domains/default/groups/75600c85-b926-497a-8a4e-6f23e1b75c2a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a [ 833.269558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75600c85-b926-497a-8a4e-6f23e1b75c2a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.270256] env[69350]: Traceback (most recent call last): [ 833.270256] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 833.270256] env[69350]: return func(*args, **kwargs) [ 833.270256] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 833.270256] env[69350]: res.raise_for_status() [ 833.270256] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 833.270256] env[69350]: raise HTTPError(http_error_msg, response=self) [ 833.270537] env[69350]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a [ 833.270537] env[69350]: During handling of the above exception, another exception occurred: [ 833.270537] env[69350]: Traceback (most recent call last): [ 833.270537] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 833.270537] env[69350]: listener.cb(fileno) [ 833.270537] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 833.270537] env[69350]: result = function(*args, **kwargs) [ 833.270537] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 833.270537] env[69350]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 833.270537] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 833.270537] env[69350]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 833.270537] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 833.270537] env[69350]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 833.270537] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 833.270537] env[69350]: res.raise_for_status() [ 833.270537] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 833.270537] env[69350]: raise HTTPError(http_error_msg, response=self) [ 833.270537] env[69350]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/75600c85-b926-497a-8a4e-6f23e1b75c2a [ 833.270537] env[69350]: Removing descriptor: 13 [ 833.305848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: IN_PROGRESS for 2s [ 833.422921] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-f3aae2ba-61bc-44b1-a740-3c62c99cee07 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 833.423640] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 833.424047] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.424188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.620419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.620613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.620662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.620869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.620976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.621110] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 833.657729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.658129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.658214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.659119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.659119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.670683] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 833.701723] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.702858] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.703026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.703349] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa7cd323-5a8a-47a0-a2ff-64375a458c22 with status ACTIVE [ 833.703518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.703641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.703706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.703884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.703970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.704144] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.704244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.704323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.704451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.704528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.704717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.704806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.704864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.705010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.705089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.705172] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa7cd323-5a8a-47a0-a2ff-64375a458c22 is going to be updated. [ 833.730461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.730578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.730617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.730824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.730997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.731151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa7cd323-5a8a-47a0-a2ff-64375a458c22" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.082604] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.082875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.082922] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.083248] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.083828] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.083938] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.083982] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.084572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.084673] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.084868] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.085108] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.085108] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.085201] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.085395] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.085510] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.085649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.110508] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.111350] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 834.111350] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.111350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.111582] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.111756] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.111957] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.113464] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.113899] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5123e9a3-bb0d-4da6-a8d2-45e5249b72ed',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.204158] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.617239] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.617495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.617629] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.617946] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.618101] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.618261] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed not found, creating... [ 834.618526] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.618686] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.618803] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.619121] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.619278] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.620733] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.620733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.620733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.620733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.620733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.620733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed is going to be created. [ 834.644971] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.645207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.645344] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.645615] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.645906] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.646145] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.661737] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 834.662031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.667670] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 834.667906] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c65be464-09bf-460a-92f1-39277c687ead deletion is rescheduled due to dependency. [ 834.668128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.709803] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.710020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.713358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.713660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.713660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.713771] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be created. [ 834.760665] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.760830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.760911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.761223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.761389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.773923] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: UNINITIALIZED for 2s [ 834.805477] env[69350]: INFO networking_nsxv3.common.synchronization [req-30cb0fd5-845f-4a7f-90d4-253e498b7d67 req-4a06237b-e663-4695-bd4a-fcd480613e17 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 834.806091] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 834.806418] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.806525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.821933] env[69350]: INFO networking_nsxv3.common.synchronization [req-30cb0fd5-845f-4a7f-90d4-253e498b7d67 req-4a06237b-e663-4695-bd4a-fcd480613e17 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 834.822154] env[69350]: INFO networking_nsxv3.common.synchronization [req-30cb0fd5-845f-4a7f-90d4-253e498b7d67 req-4a06237b-e663-4695-bd4a-fcd480613e17 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 834.822369] env[69350]: INFO networking_nsxv3.common.synchronization [req-30cb0fd5-845f-4a7f-90d4-253e498b7d67 req-4a06237b-e663-4695-bd4a-fcd480613e17 tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 834.823229] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_rules [ 834.823478] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 834.823631] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 with Priority: HIGHEST for action port [ 834.823951] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.824102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.825791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.825951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.826275] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d3b49e-ddfa-414c-94e9-df175e925d48 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.826342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.826434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.826672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.826793] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d3b49e-ddfa-414c-94e9-df175e925d48',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.994833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 834.995106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.995320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.995536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.996395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.996395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.996395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.996395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.996395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.996395] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.318874] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c65be464-09bf-460a-92f1-39277c687ead in Status: SUCCESS [ 835.319171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.328704] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d3b49e-ddfa-414c-94e9-df175e925d48 with status ACTIVE [ 835.328932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.329076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.329146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.329384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.329476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.329654] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.329756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.329850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.330160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.330233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.330423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.330518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.330580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.330720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.330796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.330880] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d3b49e-ddfa-414c-94e9-df175e925d48 is going to be updated. [ 835.354518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.354518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.354518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.354518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.354518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.354518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d3b49e-ddfa-414c-94e9-df175e925d48" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.499599] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.681111] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 835.681394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.681591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.681851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682072] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.682220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.682294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.682476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.682677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.682860] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.683054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.683168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.683298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.683472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.683595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.683664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.683827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.683910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.684066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.684126] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.918116] env[69350]: INFO networking_nsxv3.common.synchronization [req-8f000825-835a-4a6d-9744-c215605ab6da req-cbfbc115-bb94-4b10-a5eb-ed0b1263c4f3 tempest-InstanceActionsTestJSON-1427027765 tempest-InstanceActionsTestJSON-1427027765-project-member] Enqueued Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 835.918637] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGHEST for action security_group_members [ 835.918941] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.919143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.919264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.919570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.919813] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.919942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.920560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.920744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.920841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.920939] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.005529] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.111562] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-7c34810e-c517-4f07-b947-c33835d995e3 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 836.111562] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-7c34810e-c517-4f07-b947-c33835d995e3 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 836.112769] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-7c34810e-c517-4f07-b947-c33835d995e3 service nova] Enqueued Resource ID: 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed with Priority: HIGHEST for action port [ 836.112769] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 836.112769] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 836.112769] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed with Priority: HIGHEST for action port [ 836.113118] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.113118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.113118] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.113312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.113416] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.113493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.113527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.113889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.113889] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5123e9a3-bb0d-4da6-a8d2-45e5249b72ed',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.148275] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.148399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.148471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.148691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.149477] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.187646] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 836.206667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.206667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.206667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.206877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.231268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.233844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.233844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.233844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.234404] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.234563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.235372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.235372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.235372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.235558] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 836.304024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.304260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.304367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.304638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.304846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.330800] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 836.423061] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.423191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.423277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.423912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.444960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.444960] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.445208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.445208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.445603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.445767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.445914] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d is going to be updated. [ 836.475073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.475245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.475320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.475577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.475714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.485845] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: IN_PROGRESS for 2s [ 836.512027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.512027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.512027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.512027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.512195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.512195] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be updated. [ 836.544414] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.544414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.544414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.544711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.544807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.554970] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: IN_PROGRESS for 2s [ 836.617677] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed with status ACTIVE [ 836.617825] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.617972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.618057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.618278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.618406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.618600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.618716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.618827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.619067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.619180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.619879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.619879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.619879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.619879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.619879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.620430] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5123e9a3-bb0d-4da6-a8d2-45e5249b72ed is going to be updated. [ 836.643813] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.643974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.645277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.645277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.645277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.645277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5123e9a3-bb0d-4da6-a8d2-45e5249b72ed" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.651179] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.787948] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 836.788317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.788591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.788907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.789222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.789399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.789529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.789765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.789862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.790135] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.155097] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.295154] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.657060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 837.657349] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 837.797706] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.303570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.303736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.303809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.304056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.304158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.304257] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 838.359474] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 838.359708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.360718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.360863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.360931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.361125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.361275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.372371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 838.504355] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1482b722-72ef-4020-8a3f-101a71d9d71d in Status: SUCCESS [ 838.504708] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d deletion is rescheduled due to dependency. [ 838.504832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.526205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.526549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.526688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.526938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.548563] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 838.550053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.551107] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 838.565605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 838.565852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.566142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.566367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.566794] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.566936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.567084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.567355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.567462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.567563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.567672] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.568755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.568954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.569177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.569305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.569366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.569537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.569696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.569760] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.593768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.594108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.594314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.594637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.604984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.605632] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 838.605764] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 838.605929] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 838.651830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.652119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.652119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.652229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.652961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.653159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 838.716192] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.716651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.716651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.716759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.716902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.717120] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 838.775865] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.776181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.776254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.776566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.776885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.777232] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 838.777345] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1482b722-72ef-4020-8a3f-101a71d9d71d', 'c65be464-09bf-460a-92f1-39277c687ead', '2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092', '6b54caf5-2187-4343-bc88-b3ec40430d8a', '193b59c8-d498-494a-9dfe-d3babfd0943b', '9afc4840-93eb-4fb0-b332-e1e98651f1ec', 'fc83992c-258f-4908-a0ee-f421d5b307a0', '5b3f1231-5b5f-4abe-9574-aad015f9f344', '4938dad0-1aaa-448e-8a86-4203e6ccd867', 'cc3154b0-663b-480d-966a-1fbdbe6d7897', 'f9657ac2-98f3-4bb3-988b-9e7555afd46b', '424865cd-4393-4354-b973-124d1d74b508', '49b616ed-5cd5-4814-a54b-e879de71d218', '0ab8bb33-410e-45b2-83bb-f1219bc73c45', 'a3ca168c-7530-47a3-aa0d-a5c0012eaf61', 'acb732d8-60aa-4ed8-8944-d466f3eaa2e2', 'a07d8013-92b1-46a1-acb2-34b3df1ac235', '518254d1-d440-4d15-b32d-8975c834377a', '678660c3-42cf-45d8-b53c-95af67caaefb', 'efb6e556-70f9-462a-8a83-e3a295e192cf', '32ecc864-31bf-4d87-a9b7-ca366c086e55', '8bcf01dc-147d-49bc-839a-137d73c85e2d', 'bdbb2071-5801-4662-9a75-aa174ebd2139', '3373549f-c839-4d1c-a55a-af37a3148994', '2f159146-6707-4314-98f2-9023803a47fc', '01249833-e649-48c7-b9c6-9d9107bdff51', '250212f8-b7b8-4a59-919a-a1ed1d003c9a', '9d3a437f-2228-4b2f-acaf-32ef289c6c55', 'ce437c5a-9850-4106-9109-1794494f0682', 'b7d6c991-1741-482f-bd6f-0a1e7794c335'} {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 838.777474] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 838.811806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.812017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.812017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.812439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.812722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.812980] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 838.813158] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 838.813158] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 838.871762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.872034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.872123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.872386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.873230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.873506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 838.873592] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 838.873668] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 838.873735] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 838.873813] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 838.873886] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGH for action security_group_rules [ 838.874009] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGH for action security_group_rules [ 838.874127] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGH for action security_group_rules [ 838.874127] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGH for action security_group_rules [ 838.874197] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGH for action security_group_rules [ 838.874255] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGH for action security_group_rules [ 838.874320] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGH for action security_group_rules [ 838.874396] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGH for action security_group_rules [ 838.874823] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGH for action security_group_rules [ 838.874967] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGH for action security_group_rules [ 838.875093] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGH for action security_group_rules [ 838.875200] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGH for action security_group_rules [ 838.875300] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 838.875400] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGH for action security_group_rules [ 838.875502] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGH for action security_group_rules [ 838.875599] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGH for action security_group_rules [ 838.875692] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGH for action security_group_rules [ 838.875789] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGH for action security_group_rules [ 838.875888] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGH for action security_group_rules [ 838.875993] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGH for action security_group_rules [ 838.876179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.074086] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.074086] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.345494] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-be5716cd-a742-45f4-9ffd-83dc75d4ae61 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1482b722-72ef-4020-8a3f-101a71d9d71d with Priority: HIGH for action security_group_rules [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 with Priority: HIGH for action security_group_rules [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc83992c-258f-4908-a0ee-f421d5b307a0 with Priority: HIGH for action security_group_rules [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 with Priority: HIGH for action security_group_rules [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb6e556-70f9-462a-8a83-e3a295e192cf with Priority: HIGH for action security_group_rules [ 839.346780] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678660c3-42cf-45d8-b53c-95af67caaefb with Priority: HIGH for action security_group_rules [ 839.347069] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGH for action security_group_rules [ 839.347069] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGH for action security_group_rules [ 839.347207] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGH for action security_group_rules [ 839.347309] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424865cd-4393-4354-b973-124d1d74b508 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 with Priority: HIGH for action security_group_rules [ 839.348107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193b59c8-d498-494a-9dfe-d3babfd0943b with Priority: HIGH for action security_group_rules [ 839.350056] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65be464-09bf-460a-92f1-39277c687ead with Priority: HIGH for action security_group_rules [ 839.350231] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGH for action security_group_rules [ 839.350561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.350668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.352106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1482b722-72ef-4020-8a3f-101a71d9d71d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.352106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.352106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.352106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.352106] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1482b722-72ef-4020-8a3f-101a71d9d71d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.352426] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.352500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.352548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.353181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.353257] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.361619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc83992c-258f-4908-a0ee-f421d5b307a0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.361619] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc83992c-258f-4908-a0ee-f421d5b307a0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.361619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.361619] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ca168c-7530-47a3-aa0d-a5c0012eaf61',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.361619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efb6e556-70f9-462a-8a83-e3a295e192cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.363633] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efb6e556-70f9-462a-8a83-e3a295e192cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.366291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-678660c3-42cf-45d8-b53c-95af67caaefb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.366291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.366440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.366752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.366752] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('678660c3-42cf-45d8-b53c-95af67caaefb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.367734] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.367873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.367873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.367984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.368081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.369018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.369112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.369200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.369330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.369398] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.370310] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.370524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.370664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.370745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.371304] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.371728] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.371831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.371867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.372023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.372097] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb732d8-60aa-4ed8-8944-d466f3eaa2e2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.372906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.373140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.373222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.373380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.373455] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.374421] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424865cd-4393-4354-b973-124d1d74b508 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.374529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.374568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.374700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.374771] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424865cd-4393-4354-b973-124d1d74b508',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.375851] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.375851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.375955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.376119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.376158] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.376973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.377066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.377136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.377294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.377352] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.378284] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.378387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.378455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.378607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.378679] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.379595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.379702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.379768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.379916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.380086] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.381265] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b3f1231-5b5f-4abe-9574-aad015f9f344 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.381362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.381453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.381581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.381653] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b3f1231-5b5f-4abe-9574-aad015f9f344',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.382954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-193b59c8-d498-494a-9dfe-d3babfd0943b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.383077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.383145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.383298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.383371] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('193b59c8-d498-494a-9dfe-d3babfd0943b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.384403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c65be464-09bf-460a-92f1-39277c687ead taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.384513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.384589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.387033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.387033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c65be464-09bf-460a-92f1-39277c687ead',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.387033] env[69350]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 839.387033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.387033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.387033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.387033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.387033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.577306] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.578399] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32ecc864-31bf-4d87-a9b7-ca366c086e55: rpc.has_security_group_logging(os_id): False [ 839.599533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.599790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.620711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.621149] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.621932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.621932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.621932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.621932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.621932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be updated. [ 839.685110] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.685278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.685322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.685552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.685719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.707972] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: IN_PROGRESS for 2s [ 839.911868] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.912244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.912244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.912244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.912378] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.912493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.912548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.912706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.912788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.912874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.912962] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.918025] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.918025] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.918025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.918025] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.918025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.918025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.918025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.918823] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.918823] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.918823] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.921778] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.922098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.922098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.922835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.924476] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.924657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.925596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.925698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.927274] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.927274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.927646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.927756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.927925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.928161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.928307] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.928400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.928460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.928609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.928734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.928877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.928964] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.933437] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.933510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.933754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.933811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.933929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.934034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.935558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.935558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.935558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.935558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.935558] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.936032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.938341] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.938341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.938341] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.942967] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.943140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.943217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.943499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.943573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.943702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.943752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.943907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.943988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.944185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.944185] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.948022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.948022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.948022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.948022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.948022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.948022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.948737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.948737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.948737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.948737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.948737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.948737] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.950576] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.950703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.950832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.951055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.951199] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.951296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.951386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.951521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.951594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.951672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.951746] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.956672] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.960237] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.960379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.960450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.960662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.960867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.960969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.961038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.961198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.961307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.961406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.961533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.961619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.961675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.961813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.961939] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.963016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.963016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.963016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.963016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.963016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.963016] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.966236] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.971093] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.004376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.004517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.005680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.005798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.007733] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.007848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.008604] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.008693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.009489] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.009622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.010406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.010516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.011397] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.011492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.012158] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.012523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.013009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.013136] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc83992c-258f-4908-a0ee-f421d5b307a0 is going to be deleted. [ 840.014070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.014291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.021047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.021047] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.102 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 840.021047] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.021047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-394" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.021047] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.021301] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.021422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.024253] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.024253] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.041773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.041935] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1482b722-72ef-4020-8a3f-101a71d9d71d is going to be deleted. [ 840.042920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.043225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.064845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.065018] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092 is going to be deleted. [ 840.066034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.066262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.083238] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.083238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.083238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.083238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.083238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.083238] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be updated. [ 840.086617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.086617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.110888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.111157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.112557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.112892] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ca168c-7530-47a3-aa0d-a5c0012eaf61 is going to be deleted. [ 840.115675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.115675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.140824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.141078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424865cd-4393-4354-b973-124d1d74b508 is going to be deleted. [ 840.142193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.142500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.152910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.153173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.153173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.154133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.154133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.167604] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: IN_PROGRESS for 2s [ 840.174322] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.174616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.195469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.195550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.212512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.212753] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efb6e556-70f9-462a-8a83-e3a295e192cf is going to be deleted. [ 840.213900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.214036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.264778] env[69350]: INFO networking_nsxv3.common.synchronization [req-315a69ae-3136-41a2-ae8b-3a028d08a83b req-62d0c196-16c1-42b8-b110-634908c12565 tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 840.265445] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 840.266366] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.266525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.266612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.266852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.267052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.267379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.267379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.267475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.267551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.269461] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.269758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.269758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.273169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.273311] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb732d8-60aa-4ed8-8944-d466f3eaa2e2 is going to be deleted. [ 840.274228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.274454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.316524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.316709] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 193b59c8-d498-494a-9dfe-d3babfd0943b is going to be deleted. [ 840.317806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.318095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.348073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.348232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.358719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.358868] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b3f1231-5b5f-4abe-9574-aad015f9f344 is going to be deleted. [ 840.359948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.360370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.372821] env[69350]: INFO networking_nsxv3.common.synchronization [req-d21fd197-26f3-4d4c-ac31-d1234c64f397 req-5b37b677-0cad-4716-bfd4-240c5725573b tempest-AttachInterfacesUnderV243Test-1810664951 tempest-AttachInterfacesUnderV243Test-1810664951-project-member] Enqueued Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 840.374246] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 with Priority: HIGHEST for action security_group_members [ 840.374914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ecc864-31bf-4d87-a9b7-ca366c086e55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.375034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.394738] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 840.394972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.395457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.395457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.395570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.395698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.395751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.395893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.395976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.396077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.396168] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.397622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.397824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.398017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.398137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.398204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.398357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.398444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.398540] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.416157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.416157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.430701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.430701] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 678660c3-42cf-45d8-b53c-95af67caaefb is going to be deleted. [ 840.430923] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.430990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.433828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.433828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.454673] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.454898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.454898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.455721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.455721] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.455721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.455721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.455721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.455979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.455979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.456085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.456162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.456162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.460317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.460317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.460317] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.461016] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.461372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.461372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.463280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.464517] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.464794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.464910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.465278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.465413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.465569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.465829] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.465983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.466116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.466384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.466620] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.466765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.466857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.467118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.467238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.467363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.467499] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.470682] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.471731] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b54caf5-2187-4343-bc88-b3ec40430d8a: rpc.has_security_group_logging(os_id): False [ 840.474439] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afc4840-93eb-4fb0-b332-e1e98651f1ec: rpc.has_security_group_logging(os_id): False [ 840.475829] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc3154b0-663b-480d-966a-1fbdbe6d7897: rpc.has_security_group_logging(os_id): False [ 840.487468] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518254d1-d440-4d15-b32d-8975c834377a: rpc.has_security_group_logging(os_id): False [ 840.513909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.514092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.526564] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.527955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.527955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.527955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.527955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.527955] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf not found, creating... [ 840.528279] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.528453] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.528605] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.528855] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.529014] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.529439] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.532031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.532031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.532031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.532031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.532031] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf is going to be created. [ 840.533303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.533500] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be deleted. [ 840.534619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.534832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.550390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.550571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.561047] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.562034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.562494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.562666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.566748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.566932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.591364] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.591364] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.591364] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.591598] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.591919] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.592802] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.599947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.600203] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c65be464-09bf-460a-92f1-39277c687ead is going to be deleted. [ 840.601438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.602043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.602043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.602613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc83992c-258f-4908-a0ee-f421d5b307a0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.602959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.603339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.603517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.603870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1482b722-72ef-4020-8a3f-101a71d9d71d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.606692] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.606798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.606873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.607186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.607380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.607624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-678660c3-42cf-45d8-b53c-95af67caaefb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.607818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.608090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.608722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.608909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4e2dbc-3b8a-4d58-b30c-c4e89d0f1092" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.609071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.609259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.609484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.609484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ca168c-7530-47a3-aa0d-a5c0012eaf61" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.610525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.610692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.610692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.610877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.610958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.611130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-193b59c8-d498-494a-9dfe-d3babfd0943b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.611266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.611432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.611526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.611645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424865cd-4393-4354-b973-124d1d74b508" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.611769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.611924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.612027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efb6e556-70f9-462a-8a83-e3a295e192cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.612592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.612592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb732d8-60aa-4ed8-8944-d466f3eaa2e2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.613009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.618088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.618088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b3f1231-5b5f-4abe-9574-aad015f9f344" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.618088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.618088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.689239] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.689481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.708732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.709069] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.709195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.709273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.709532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.709623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.709833] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.709928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.710148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.710347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.710439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.710633] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.710738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.710811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.711034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.711155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.711263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 840.713293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.713485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.772322] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.803136] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.803136] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be updated. [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.803136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.822902] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.822902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.854032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.854032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 is going to be updated. [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.854032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.903121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.903121] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.903121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.903121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.903121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.903121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.903121] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 840.904896] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.905230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.905516] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.906528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.906841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.907055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.907255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c65be464-09bf-460a-92f1-39277c687ead" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.907500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.908901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.908901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.908901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.963103] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 840.976576] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ab8bb33-410e-45b2-83bb-f1219bc73c45: rpc.has_security_group_logging(os_id): False [ 840.976576] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4938dad0-1aaa-448e-8a86-4203e6ccd867: rpc.has_security_group_logging(os_id): False [ 841.010446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.013020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.013020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.013020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.014443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.014692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.015870] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.016315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.048649] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.048649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.067666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.068369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.106986] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.106986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.125048] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.125048] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.125048] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.125686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.125686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.125686] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 841.127029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.127290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.146987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.146987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.194884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.195388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.195507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.195607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.195861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.196262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.196435] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 841.197794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.198069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.198292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.199978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.200316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.200505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.201589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.201769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.201899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.202865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.203047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.274792] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.277624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: IN_PROGRESS for 2s [ 841.285448] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: IN_PROGRESS for 2s [ 841.291597] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 841.314389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.314699] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.314825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.314892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.315187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.315283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.315535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.315673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.315711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.315906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.316490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.316822] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.317869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.317998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.318552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.318702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.318833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 841.320445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.320566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.320753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.341976] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.341976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.341976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.341976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.341976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.356535] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 841.371738] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-c3bf7c83-7f28-4014-8ccf-359cd03e0471 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 841.371981] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-c3bf7c83-7f28-4014-8ccf-359cd03e0471 service nova] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 841.372172] env[69350]: INFO networking_nsxv3.common.synchronization [req-aa5ad8c5-febe-4b47-b3ce-c16305ba79e3 req-c3bf7c83-7f28-4014-8ccf-359cd03e0471 service nova] Enqueued Resource ID: dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf with Priority: HIGHEST for action port [ 841.372787] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_rules [ 841.372962] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 841.373114] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf with Priority: HIGHEST for action port [ 841.373439] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.373577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.373826] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.373946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.374189] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.374317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.374407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.374654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.374761] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.398506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 841.407486] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.407640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.407748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.407966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.408221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.409870] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.466363] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.466520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.466592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.466825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.466976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.469207] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 841.488049] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 841.723246] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 841.726152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.726152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.726152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.726152] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.778087] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.778087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.778087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.778087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.778426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.778426] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 841.808509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.808673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.808716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.808935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.809103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.820484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 841.877633] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf with status ACTIVE [ 841.877883] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.878081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.878081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.878261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.878357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.879035] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.879035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.879035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.879035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.879035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.879439] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.879559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.879624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.879778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.879854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.879940] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf is going to be updated. [ 841.912351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.912540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.912624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.912881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.912942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.913058] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 841.916377] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.916520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.916569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.916777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.916917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.917844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc85d114-78ba-4b8a-af3d-4fa09ef2f6bf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.944855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.944855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.944855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.944855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.944855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.955695] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 842.131581] env[69350]: INFO networking_nsxv3.common.synchronization [req-a6d6237b-b215-419d-a191-2ebdf369b4a6 req-14de9eb8-7ec0-4f74-90b8-96865954f7c3 tempest-ServersV294TestFqdnHostnames-993868252 tempest-ServersV294TestFqdnHostnames-993868252-project-member] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 842.132504] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 842.132903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.133047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.133121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.133452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.133668] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.133785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.133853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.134031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.134132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.134234] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.178510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 in Status: SUCCESS [ 842.178733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.179327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.179327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.179327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.179500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.179500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.179657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.179736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.179835] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.253434] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.253434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.253434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.253701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.253701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.253796] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be deleted. [ 842.324257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.324257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.324257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.324257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.324257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.324257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.636600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.637891] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.637891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.638311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.638311] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b already deleted. [ 842.638311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.655991] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.656213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-584" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.656338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-584" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.656687] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-584" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.656957] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.657212] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.657334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.657568] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.657729] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.657998] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.658101] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.658218] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.658324] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.658456] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.658539] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.658698] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.684423] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.684730] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.684900] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.685143] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-584" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.686311] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-f781071d-b3da-4892-a03d-d7ace8c2044c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.686311] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.686311] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.686863] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.686863] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f781071d-b3da-4892-a03d-d7ace8c2044c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.688059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.688191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.688237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.688451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.688583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.688807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.688919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.689014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.689241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.689353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.689448] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 is going to be deleted. [ 842.725764] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.725924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.725993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.726230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.726419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.726548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.726977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.727159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.727312] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.727413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.727473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.727605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.727677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.727764] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ecc864-31bf-4d87-a9b7-ca366c086e55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.957842] env[69350]: INFO networking_nsxv3.common.synchronization [req-93bed295-aea3-40db-8d4f-993ae7bb18b9 req-facdde59-31b2-428d-b776-d1c5659938e7 tempest-ServerRescueTestJSON-370583535 tempest-ServerRescueTestJSON-370583535-project-member] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 842.959053] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 842.959596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.959752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.959822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.960105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.960284] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.960429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.960485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.960623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.960709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.961603] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.192620] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.193088] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.193088] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.193349] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.193513] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.193677] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port f781071d-b3da-4892-a03d-d7ace8c2044c not found, creating... [ 843.193950] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.194133] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.194254] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.194726] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.194768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.195106] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.195289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.195412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.195649] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.195850] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.195942] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: f781071d-b3da-4892-a03d-d7ace8c2044c is going to be created. [ 843.230606] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.230744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.230786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.231035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.231133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.231344] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.231446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.231511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.231668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.231741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.231827] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ecc864-31bf-4d87-a9b7-ca366c086e55 already deleted. [ 843.231903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ecc864-31bf-4d87-a9b7-ca366c086e55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.243194] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.243577] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.243792] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.244221] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.244604] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.244965] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.316571] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: SUCCESS [ 843.316571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.317481] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: SUCCESS [ 843.317686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.329878] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 843.329878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.377193] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 843.377583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.423955] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 843.424318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.464992] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.487808] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 843.487808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.507328] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 843.507617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.832345] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 843.832345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.832704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.832764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.833026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.833144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.833218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.833364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.833467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.833568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.833784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.833999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.833999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.834171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.834311] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.834425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.834508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.834669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.834772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.834861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.834977] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.968087] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 843.969367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.970144] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.972335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.975065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.975509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.975895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.976176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.976453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.976871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.977116] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [req-a6d6237b-b215-419d-a191-2ebdf369b4a6 req-ddd856dd-a2d5-41e5-83cd-3cc5eafb36a4 service nova] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [req-a6d6237b-b215-419d-a191-2ebdf369b4a6 req-ddd856dd-a2d5-41e5-83cd-3cc5eafb36a4 service nova] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [req-a6d6237b-b215-419d-a191-2ebdf369b4a6 req-ddd856dd-a2d5-41e5-83cd-3cc5eafb36a4 service nova] Enqueued Resource ID: f781071d-b3da-4892-a03d-d7ace8c2044c with Priority: HIGHEST for action port [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_rules [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 844.027261] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f781071d-b3da-4892-a03d-d7ace8c2044c with Priority: HIGHEST for action port [ 844.029362] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.029528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.029604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.029832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.030055] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.031271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.031271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.031271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.031853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.031853] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.031853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.031853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.032065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.032065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.032065] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.033727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f781071d-b3da-4892-a03d-d7ace8c2044c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.033727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.033727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.033727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.033727] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f781071d-b3da-4892-a03d-d7ace8c2044c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.336990] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a07d8013-92b1-46a1-acb2-34b3df1ac235: rpc.has_security_group_logging(os_id): False [ 844.356825] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.357060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.357060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.357272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.377692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.378023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.378171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.378244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.378452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.378538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.378747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.378842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.378905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.379065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.379142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.379327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.379422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.379484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.379624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.379699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.379785] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 844.470969] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.471205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.471259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.471469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.471625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.480144] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.480144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.480144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.480144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.480436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.480436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be updated. [ 844.481764] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.492542] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 844.508723] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.508871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.508946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.509228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.509356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.519816] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 844.535321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.535484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.535550] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.536612] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f781071d-b3da-4892-a03d-d7ace8c2044c with status ACTIVE [ 844.536833] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.536925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.536992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.537235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.537331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.537499] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.537596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.537655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.537800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.537876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.538114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.538218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.538279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.538424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.538498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.538585] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f781071d-b3da-4892-a03d-d7ace8c2044c is going to be updated. [ 844.575584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.575584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.575584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.575584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.575584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.575584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f781071d-b3da-4892-a03d-d7ace8c2044c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.984915] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.019911] env[69350]: INFO networking_nsxv3.common.synchronization [req-ed6d4c23-1366-4e39-ae91-4fd9749f5bb5 req-79652db7-ee19-4dd9-a1c6-f0989871bf9d tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 845.020506] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 845.020804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.020920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.020984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.021554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.021709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.021825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.021889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.022049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.022133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.023204] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.041261] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.488021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.488021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.488021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.488021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.488021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.488021] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 845.525717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.525957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.526104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.526382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.546450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.546653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.546772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.547008] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.547149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.547292] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b is going to be created. [ 845.550300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.550300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.550300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.550300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.550496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.550569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.550670] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 845.553294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.553392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.553429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.553623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.553797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.564629] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 845.574475] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.574702] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.574820] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.575130] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.575422] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.575602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.575763] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.576053] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.576211] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.576433] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.576551] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.576664] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.576773] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.576916] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.577121] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.577318] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.579867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.579867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.579867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.580216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.580216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.582353] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.582477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.582574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.582759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.582923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.598665] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 845.599333] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: UNINITIALIZED for 2s [ 845.608838] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.609048] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.609201] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.609411] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.609754] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-45067217-394c-43f1-97e3-6d455245c2c6 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.609938] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.610137] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.610504] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.610651] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45067217-394c-43f1-97e3-6d455245c2c6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.113719] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.114154] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.114319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.114653] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.114915] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.115237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 45067217-394c-43f1-97e3-6d455245c2c6 not found, creating... [ 846.115645] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.116485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.116485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.116485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.116485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.117643] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.117753] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.117824] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.118347] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.118347] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.118586] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 45067217-394c-43f1-97e3-6d455245c2c6 is going to be created. [ 846.144537] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.144755] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.144883] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.145198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.145446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.145757] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.509724] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 846.509724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.531092] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 846.531369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.886373] env[69350]: INFO networking_nsxv3.common.synchronization [req-ed6d4c23-1366-4e39-ae91-4fd9749f5bb5 req-25b8a593-eb37-45fd-8306-7c6d914d8805 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 846.886373] env[69350]: INFO networking_nsxv3.common.synchronization [req-ed6d4c23-1366-4e39-ae91-4fd9749f5bb5 req-25b8a593-eb37-45fd-8306-7c6d914d8805 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 846.886373] env[69350]: INFO networking_nsxv3.common.synchronization [req-ed6d4c23-1366-4e39-ae91-4fd9749f5bb5 req-25b8a593-eb37-45fd-8306-7c6d914d8805 service nova] Enqueued Resource ID: 45067217-394c-43f1-97e3-6d455245c2c6 with Priority: HIGHEST for action port [ 846.886763] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 846.886935] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 846.887147] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45067217-394c-43f1-97e3-6d455245c2c6 with Priority: HIGHEST for action port [ 846.887604] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.887810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.889478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.889478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.889478] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.891262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891949] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-45067217-394c-43f1-97e3-6d455245c2c6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.893095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.893095] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45067217-394c-43f1-97e3-6d455245c2c6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.391033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.391244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.394722] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45067217-394c-43f1-97e3-6d455245c2c6 with status ACTIVE [ 847.394871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.395147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.395147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.395310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.395396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.395639] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.395719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.395719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.395868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.395941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.396137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.396322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.396322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.396443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.396514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.396599] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45067217-394c-43f1-97e3-6d455245c2c6 is going to be updated. [ 847.421930] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.422144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.422237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.422503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.422665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.422859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45067217-394c-43f1-97e3-6d455245c2c6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.575251] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 847.575542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.575642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.575872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.576069] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.576191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.576281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.576423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.576501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.576589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.576750] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.576831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.576891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.577041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.577180] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.577270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.577331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.577471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.577535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.577619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.577709] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.578624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.578797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.578942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.579054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.579121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.579297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.579353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.579435] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.611673] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 847.611858] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 deletion is rescheduled due to dependency. [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.614041] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.614041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.614041] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.615531] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: SUCCESS [ 847.615728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.615881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.616083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.616280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.616412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.616448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.616616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.616732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.616788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.616863] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.081701] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a393ca-d0ba-4ee5-9055-2295ecf1b143: rpc.has_security_group_logging(os_id): False [ 848.082878] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.102025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.102025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.102328] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.102328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.102328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.102470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.102554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.102746] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.102840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.102899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.103050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.103129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.103323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.105105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.105105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.105105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.105105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.105105] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be created. [ 848.116031] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.118634] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.165774] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.165975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.166073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.166316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.166506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.177474] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 848.585410] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.590020] env[69350]: INFO networking_nsxv3.common.synchronization [req-03f6cde5-a334-4d9d-9b96-08efe1b70b54 req-d546a81a-14d0-4a5e-bc44-6ac88a9e4e2f tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 848.590889] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 848.595277] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.595466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.595731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.595804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.595989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.596114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.596177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.596400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.596478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.596571] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.618342] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.620969] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffa8eacd-d072-4180-a46b-fc0e52002a8b: rpc.has_security_group_logging(os_id): False [ 848.643489] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.643633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.643633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.643937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.644057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.644329] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.644441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.644491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.644667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.644810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.644857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b is going to be created. [ 848.714937] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.715165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.715249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.715401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.715588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.728629] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: IN_PROGRESS for 2s [ 849.090786] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.090786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.090786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.090786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.090786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.090786] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 849.102952] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.122132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.122132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.122132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.122132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.122132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.124094] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.124094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.124094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.124094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.124094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.124591] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 849.136630] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 849.160175] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.160175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.160175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.160175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.160175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.167597] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 849.192918] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.192918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.192918] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.194076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.194076] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.194076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.194076] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.194471] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.194629] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.194924] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.195114] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.195287] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.195573] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.195573] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.195736] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.195922] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.218885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.218885] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.219100] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.219206] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.220668] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.220668] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.220668] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.220668] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.220961] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0e5024-ea2a-4a57-8f96-1b095c72a5bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.604815] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.723697] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.723830] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.723930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.724314] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.724521] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.726882] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc not found, creating... [ 849.727515] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.727952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.727952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.728157] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.730068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.730068] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.730068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.730068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.730068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.730068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.730068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc is going to be created. [ 849.754030] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.754030] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.754030] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.754237] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.754332] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.754658] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.107618] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.107848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.107908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.108141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.108289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.108401] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 850.145174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.146098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.146098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.146098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.146326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.155710] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 850.202936] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 850.203268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.203461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.203695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.203788] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.512306] env[69350]: INFO networking_nsxv3.common.synchronization [req-03f6cde5-a334-4d9d-9b96-08efe1b70b54 req-ceb69594-f830-46c3-9359-bf023c727e35 service nova] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_rules [ 850.512306] env[69350]: INFO networking_nsxv3.common.synchronization [req-03f6cde5-a334-4d9d-9b96-08efe1b70b54 req-ceb69594-f830-46c3-9359-bf023c727e35 service nova] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 850.512306] env[69350]: INFO networking_nsxv3.common.synchronization [req-03f6cde5-a334-4d9d-9b96-08efe1b70b54 req-ceb69594-f830-46c3-9359-bf023c727e35 service nova] Enqueued Resource ID: 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc with Priority: HIGHEST for action port [ 850.512621] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_rules [ 850.512779] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 850.512879] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc with Priority: HIGHEST for action port [ 850.514676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.514832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.514907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.515173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.515271] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.519301] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.519301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.519301] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.519301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.519301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.519301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.519301] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0e5024-ea2a-4a57-8f96-1b095c72a5bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.709042] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.709817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.742887] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: SUCCESS [ 850.743155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.017796] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.017981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.020339] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc with status ACTIVE [ 851.020580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.020712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.020778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.020995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.021098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022086] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022086] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.022086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.022654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022654] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a0e5024-ea2a-4a57-8f96-1b095c72a5bc is going to be updated. [ 851.045318] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.045318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.045318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.045842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.045842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.045842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a0e5024-ea2a-4a57-8f96-1b095c72a5bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.150431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 851.150658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.150830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.151068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.151332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.151454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.151522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.151679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.151759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.151876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.151922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.181615] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 851.181836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.182038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.182265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.182562] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.182687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.182754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.182914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.182978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.185891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.185891] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.300831] env[69350]: INFO networking_nsxv3.common.synchronization [None req-8d2ec4b7-988f-457e-a6c1-cb2fc0b4481e tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 851.301726] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 851.301806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.301913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.301969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.302223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.302306] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.405832] env[69350]: INFO networking_nsxv3.common.synchronization [None req-403ee594-05c5-4152-86a4-975895093c70 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 851.406692] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 851.407317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.407579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.654248] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.654585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.654585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.654750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.654873] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.654969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.655046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.655196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.655280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.655368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.655511] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.655601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.655668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.659022] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.659022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.659022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.685748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.685748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.685748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.686138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.686207] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.686336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.686336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.686501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.686594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.686678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.686824] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.686915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.686974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.687134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.687266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.687373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.687446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.687620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.687697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.687780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.687867] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.829096] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.829563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.829563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.829730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.829730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.829814] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e already deleted. [ 851.829868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.830058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.830295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.830381] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.032495] env[69350]: INFO networking_nsxv3.common.synchronization [req-feac99b3-f9b3-43f0-bae4-076647686b72 req-91a07c1a-da1c-4237-ad4a-8d984b269d58 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 852.032976] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 852.033875] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.034516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.034516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.034516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.034913] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.035032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.035301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.035669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.035736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.035914] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.158873] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a393ca-d0ba-4ee5-9055-2295ecf1b143: rpc.has_security_group_logging(os_id): False [ 852.177529] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 852.177781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.177924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.178193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178363] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.178503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.178564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.179041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.179041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.179041] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.181038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.181181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.181266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.181488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.181616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.181809] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.181913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.181976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.182141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.182317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.182538] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.182538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.182668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.182700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.182766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.182960] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.183084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.183154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.183292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.183368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.183452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 852.190393] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3373549f-c839-4d1c-a55a-af37a3148994: rpc.has_security_group_logging(os_id): False [ 852.215800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.215992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.216135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.216585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.216585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.216736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.216999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.217108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.217283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.217366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.217618] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.217742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.217825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.217999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.218116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.218325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.218458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.219904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.219904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.219904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.219904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 852.273046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.273046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.273046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.273046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.273046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.283215] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.284065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.284065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.284065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.284065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.289657] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 852.318467] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 852.355139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.355317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.355357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.355619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.355723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.355814] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e already deleted. [ 852.356142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.538670] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.538753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.538792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.538992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.539153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.539300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.539437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.539437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.539590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.539656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.539739] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 852.575233] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.575233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.575233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.575531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.575570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.590691] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 852.685885] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.188764] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.395840] env[69350]: INFO networking_nsxv3.common.synchronization [req-d6f28bdf-9545-4bad-a10f-593798bcf1f5 req-442c33ba-41f4-4b52-9a6f-adaa2396b3d4 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 853.395840] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 853.395993] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.396228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.396318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.396644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.396811] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.396912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.397027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.397158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.397447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.397673] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.693399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.693573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.693651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.693843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.693942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.694648] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 853.726701] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.726782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.726818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.727022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.727172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.736608] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 853.900342] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.324448] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 854.324448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.324872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.324872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.325019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.334536] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 854.334931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.402932] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.599662] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 854.599877] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 854.599990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.831258] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.831493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.068201] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.068655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.068819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.069449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.069449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.069449] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 855.106346] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.106628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.106628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.106933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.107100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.117272] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 855.749018] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 855.749018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.749018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.749018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.749515] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.749515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.749515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.749693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.749693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.749693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.749842] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.253570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.253761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.253824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.254068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.254236] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.254467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.254467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.254595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.254681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.254779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.254937] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.255054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.255163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.255256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.255399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.255490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.255565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.255701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.255773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.255862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.255953] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.759461] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ab8bb33-410e-45b2-83bb-f1219bc73c45: rpc.has_security_group_logging(os_id): False [ 856.792593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.792859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.792988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.797264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.797830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.797830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.797830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797830] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 856.870935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.871157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.871242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.871497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.871681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.889385] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 857.128180] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 857.128482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.128620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.128850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.130954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.130954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.130954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.130954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.130954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.130954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.130954] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.632634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.632877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.632932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.633175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.633350] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.633455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.633520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.633675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.633766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.633853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.633998] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.634108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.634211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.634311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.634447] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.634538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.634599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.634738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.634815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.634897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.634987] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.137757] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a393ca-d0ba-4ee5-9055-2295ecf1b143: rpc.has_security_group_logging(os_id): False [ 858.157639] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.158063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.158368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.158608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.158745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.158911] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.159027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.159109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.159298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.159298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.159495] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.160063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.160063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.160063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.160063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.160340] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.160340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.160645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.160857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.160960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.161085] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 858.227493] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.227493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.227493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.227493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.227493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.244419] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 858.397136] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 858.397280] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 858.905959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 858.905959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.566363] env[69350]: INFO networking_nsxv3.common.synchronization [req-34a7c7d3-b82a-493f-9331-a8fefcc72373 req-ec8b07e4-36a9-4642-a4e1-cca4a1ad9310 tempest-ListImageFiltersTestJSON-65517452 tempest-ListImageFiltersTestJSON-65517452-project-member] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 859.567200] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 859.567323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.567458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.567458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.567969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.567969] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.567969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.568225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.568877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.568877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.568877] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.944612] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.944612] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.945583] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.946041] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.946452] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.946788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.947060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.947414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.947694] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.948032] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.948293] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.948797] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.949053] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.949282] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.949499] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.949753] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.979198] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.979198] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.979198] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.979198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.979198] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-fa7baa3c-9c73-4caa-9579-81de2f2390ab taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.979198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.979198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.979198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.979198] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7baa3c-9c73-4caa-9579-81de2f2390ab',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.072118] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.072724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.072724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.072844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.072893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.074331] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.075086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.075228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.075456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.075965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.075965] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 already deleted. [ 860.075965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.261505] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 860.261734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.438119] env[69350]: INFO networking_nsxv3.common.synchronization [None req-aad05521-61fa-4db6-b673-310eb1355a30 None None] Enqueued Resource ID: 7def0d3b-d95e-432c-a5b9-581ef83b2f1d with Priority: HIGHEST for action port [ 860.438399] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7def0d3b-d95e-432c-a5b9-581ef83b2f1d with Priority: HIGHEST for action port [ 860.438846] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7def0d3b-d95e-432c-a5b9-581ef83b2f1d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.442092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7def0d3b-d95e-432c-a5b9-581ef83b2f1d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.442092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7def0d3b-d95e-432c-a5b9-581ef83b2f1d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.442092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7def0d3b-d95e-432c-a5b9-581ef83b2f1d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.442092] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7def0d3b-d95e-432c-a5b9-581ef83b2f1d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.484560] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.484942] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.485175] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.487162] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.487458] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.487736] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port fa7baa3c-9c73-4caa-9579-81de2f2390ab not found, creating... [ 860.488200] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.488475] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.488687] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.489091] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.490515] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.490515] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.490515] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.490515] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.490840] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.490973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.491380] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: fa7baa3c-9c73-4caa-9579-81de2f2390ab is going to be created. [ 860.516373] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.516603] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.516603] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.516876] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.517135] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.517369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.944459] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7def0d3b-d95e-432c-a5b9-581ef83b2f1d [ 860.944776] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.944776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.944897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.945180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.945279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.945399] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7def0d3b-d95e-432c-a5b9-581ef83b2f1d already deleted. [ 860.945519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7def0d3b-d95e-432c-a5b9-581ef83b2f1d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [req-34a7c7d3-b82a-493f-9331-a8fefcc72373 req-577d2a34-38c4-40ae-9e58-68ea697db25f service nova] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_rules [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [req-34a7c7d3-b82a-493f-9331-a8fefcc72373 req-577d2a34-38c4-40ae-9e58-68ea697db25f service nova] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [req-34a7c7d3-b82a-493f-9331-a8fefcc72373 req-577d2a34-38c4-40ae-9e58-68ea697db25f service nova] Enqueued Resource ID: fa7baa3c-9c73-4caa-9579-81de2f2390ab with Priority: HIGHEST for action port [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_rules [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 861.357018] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7baa3c-9c73-4caa-9579-81de2f2390ab with Priority: HIGHEST for action port [ 861.357018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.357018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.357018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.357018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.357018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.357977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.357977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.357977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.357977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.358200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.358248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.358323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.362033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.362033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.362033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.362033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa7baa3c-9c73-4caa-9579-81de2f2390ab taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.362033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.362033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.362033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.362033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7baa3c-9c73-4caa-9579-81de2f2390ab',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.801145] env[69350]: INFO networking_nsxv3.common.synchronization [req-678daab6-3eaa-4b73-b80d-aa708d38addf req-d1908ebd-8ca6-4972-890d-3273bb176b5b tempest-ListImageFiltersTestJSON-65517452 tempest-ListImageFiltersTestJSON-65517452-project-member] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 861.801691] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 861.802025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.802134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.863667] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.863667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.863667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.864085] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa7baa3c-9c73-4caa-9579-81de2f2390ab with status ACTIVE [ 861.864085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.864085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.864085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.864854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.864854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.864854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.864854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.864854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.864854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.865147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.866814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.866814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.866814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.866814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.867055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.867104] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa7baa3c-9c73-4caa-9579-81de2f2390ab is going to be updated. [ 861.892901] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.893085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.893156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.893366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.893498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.893651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa7baa3c-9c73-4caa-9579-81de2f2390ab" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.214398] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.214697] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.214932] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.215305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.215590] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.215762] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.217371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.217371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.217371] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.217371] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.217371] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.217371] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.217371] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.217371] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.217371] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.217371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.241189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.241189] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.241189] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.241189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.243566] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6f1e00c5-40ec-4744-8246-317789199ac2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.243566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.243566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.244095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.244647] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f1e00c5-40ec-4744-8246-317789199ac2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.369645] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.548205] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9257761b-5f41-4886-8a6d-8c15502da293 None None] Enqueued Resource ID: df01c7be-2bf0-4c8b-b033-398d8dc2566d with Priority: HIGHEST for action port [ 862.548205] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df01c7be-2bf0-4c8b-b033-398d8dc2566d with Priority: HIGHEST for action port [ 862.548709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-df01c7be-2bf0-4c8b-b033-398d8dc2566d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.550499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df01c7be-2bf0-4c8b-b033-398d8dc2566d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.550582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df01c7be-2bf0-4c8b-b033-398d8dc2566d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.550894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df01c7be-2bf0-4c8b-b033-398d8dc2566d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.551016] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df01c7be-2bf0-4c8b-b033-398d8dc2566d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.751491] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.752438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.752438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.752438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.752438] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.752690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6f1e00c5-40ec-4744-8246-317789199ac2 not found, creating... [ 862.753324] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.753324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.753324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.753517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.753517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.753770] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.754510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.754510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.754510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.755298] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.755484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6f1e00c5-40ec-4744-8246-317789199ac2 is going to be created. [ 862.778883] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.779144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.779277] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.779579] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.780034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.780380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.874987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.874987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.874987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.874987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.874987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.874987] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be created. [ 862.914254] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.914254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.914254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.914254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.914254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.923146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: UNINITIALIZED for 2s [ 863.054575] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df01c7be-2bf0-4c8b-b033-398d8dc2566d [ 863.054807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.054987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.055052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.055269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.055362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.056052] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df01c7be-2bf0-4c8b-b033-398d8dc2566d already deleted. [ 863.056052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df01c7be-2bf0-4c8b-b033-398d8dc2566d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.553296] env[69350]: INFO networking_nsxv3.common.synchronization [req-678daab6-3eaa-4b73-b80d-aa708d38addf req-24477cfa-678e-4357-ac83-8b5842fd8f60 service nova] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_rules [ 863.553568] env[69350]: INFO networking_nsxv3.common.synchronization [req-678daab6-3eaa-4b73-b80d-aa708d38addf req-24477cfa-678e-4357-ac83-8b5842fd8f60 service nova] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 863.553720] env[69350]: INFO networking_nsxv3.common.synchronization [req-678daab6-3eaa-4b73-b80d-aa708d38addf req-24477cfa-678e-4357-ac83-8b5842fd8f60 service nova] Enqueued Resource ID: 6f1e00c5-40ec-4744-8246-317789199ac2 with Priority: HIGHEST for action port [ 863.554316] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_rules [ 863.554478] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 863.554638] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1e00c5-40ec-4744-8246-317789199ac2 with Priority: HIGHEST for action port [ 863.554964] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.556651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.556749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.556832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.557669] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f1e00c5-40ec-4744-8246-317789199ac2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.557803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.557924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.558126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.558216] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f1e00c5-40ec-4744-8246-317789199ac2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.060604] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f1e00c5-40ec-4744-8246-317789199ac2 with status ACTIVE [ 864.060604] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.060604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.060604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.060913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.060913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.061208] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.061316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.061316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.061466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.062075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.062075] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.062075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.062075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.062075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.062075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.062458] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f1e00c5-40ec-4744-8246-317789199ac2 is going to be updated. [ 864.087842] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.088124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.088293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.088606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.088827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.089128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f1e00c5-40ec-4744-8246-317789199ac2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.550984] env[69350]: INFO networking_nsxv3.common.synchronization [req-102eccaa-c6e2-49e3-8272-dfc1fa4f4276 req-1c2f7dc1-1f63-4ae1-86eb-d0dcbc6060a8 tempest-ImagesNegativeTestJSON-1300475273 tempest-ImagesNegativeTestJSON-1300475273-project-member] Enqueued Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 864.551283] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 864.551643] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.551789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.551856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.553081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.553081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.553081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.553081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.553081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.553081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.553081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.938337] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 864.938525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.938828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.939086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.939353] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.939513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.939640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.939697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.939781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.939934] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.055844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.057041] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.057041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.057627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.057627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.057627] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 already deleted. [ 865.057627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.171888] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-878 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.172300] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-878" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.173060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-878" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.173060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-878" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.174295] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.174295] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.174295] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.174503] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.174654] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.174906] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.175042] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.178022] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.178022] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.178022] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.178022] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.178022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.195275] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.195470] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.195625] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.195833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-878" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.196210] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e92694a8-1f02-4496-860e-5ec727b40069 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.196415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.196557] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.196917] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.197092] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e92694a8-1f02-4496-860e-5ec727b40069',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.441891] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.700776] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.701163] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.701163] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.701460] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.701654] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.701815] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port e92694a8-1f02-4496-860e-5ec727b40069 not found, creating... [ 865.702092] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.702256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.702377] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.702601] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.702769] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.703070] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.703251] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.703355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.703569] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.703728] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.703845] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e92694a8-1f02-4496-860e-5ec727b40069 is going to be created. [ 865.725329] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.725674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.725862] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.726175] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.726415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.726646] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.944457] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.447995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.448239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.448376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.448626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.449176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.449176] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be updated. [ 866.485020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.485020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.485020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.485020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.485020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.494402] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [req-102eccaa-c6e2-49e3-8272-dfc1fa4f4276 req-d012d668-5350-46a6-a071-691b3dea75c1 service nova] Enqueued Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_rules [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [req-102eccaa-c6e2-49e3-8272-dfc1fa4f4276 req-d012d668-5350-46a6-a071-691b3dea75c1 service nova] Enqueued Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [req-102eccaa-c6e2-49e3-8272-dfc1fa4f4276 req-d012d668-5350-46a6-a071-691b3dea75c1 service nova] Enqueued Resource ID: e92694a8-1f02-4496-860e-5ec727b40069 with Priority: HIGHEST for action port [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_rules [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 866.587446] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e92694a8-1f02-4496-860e-5ec727b40069 with Priority: HIGHEST for action port [ 866.587446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.587446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.587446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.587446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.587446] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.588477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.588477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.588477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.588477] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.590124] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e92694a8-1f02-4496-860e-5ec727b40069 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.590239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.590300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.590486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.591200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e92694a8-1f02-4496-860e-5ec727b40069',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.094506] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.097387] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.097387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.097387] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e92694a8-1f02-4496-860e-5ec727b40069 with status ACTIVE [ 867.097387] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.097387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.097387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.097387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.097858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.097858] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.097858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.097971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.098189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.098396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.099395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.099395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.099666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.099666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.099755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.099790] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e92694a8-1f02-4496-860e-5ec727b40069 is going to be updated. [ 867.123033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.123033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.123271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.123376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.124357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.124357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e92694a8-1f02-4496-860e-5ec727b40069" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.601662] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.111190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.111190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.111190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.111190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.111190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.111190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 is going to be created. [ 868.140404] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.140404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.140404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.140404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.140404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.150524] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: UNINITIALIZED for 2s [ 868.514013] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 868.514252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.514419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.514652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.514843] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.514977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.515050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.515213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.515296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.515415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.515531] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.516501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.516694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.518028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.518028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.518028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.518028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.518028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.518406] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.021809] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.021809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.021809] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.526301] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.033134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.033134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.033134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.033134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.033134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.033134] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be updated. [ 870.059573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.059766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.059836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.060358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.060358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.071049] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 870.162393] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: SUCCESS [ 870.162704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.162704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.162938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.163476] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.163476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.163476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.163805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.163805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.163805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.163805] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.292087] env[69350]: INFO networking_nsxv3.common.synchronization [req-5f3b4352-3f94-4acb-88f0-0be8ba6b36ab req-2158b00f-c61c-4262-b790-c1dd8b208964 tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 870.293108] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 870.293469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.293638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.293728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.294056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.294207] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.294329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.294407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.294624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.294717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.294832] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.669409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.669409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.669409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.669409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.669409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.670360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.670360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.670360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.670360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.670360] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.800664] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.800664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.800664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.800664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.800664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.801032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.801032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.801032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.801160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.801209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.801244] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 870.839460] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.839686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.839747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.839951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.840116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.852851] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 871.175404] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30f3c1b0-c88c-48f8-a076-d6df7cdbf573: rpc.has_security_group_logging(os_id): False [ 871.196033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.196033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.196344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.196344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.196455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.196637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.196740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.196800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.196955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.197048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.197235] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.197374] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.197374] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.197531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.197591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.197936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.197936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.197936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.198476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.198611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.198778] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 is going to be created. [ 871.273368] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.273598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.273646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.273852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.274045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.284523] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: IN_PROGRESS for 2s [ 871.628081] env[69350]: INFO networking_nsxv3.common.synchronization [req-8b374af3-8f66-4dbf-988a-be03fcd14fc7 req-0b48b5a6-2554-4650-a127-d2f50e5f4b76 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 871.629221] env[69350]: INFO networking_nsxv3.common.synchronization [req-8b374af3-8f66-4dbf-988a-be03fcd14fc7 req-0b48b5a6-2554-4650-a127-d2f50e5f4b76 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 871.629221] env[69350]: INFO networking_nsxv3.common.synchronization [req-8b374af3-8f66-4dbf-988a-be03fcd14fc7 req-0b48b5a6-2554-4650-a127-d2f50e5f4b76 tempest-SecurityGroupsTestJSON-731750286 tempest-SecurityGroupsTestJSON-731750286-project-member] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 871.629990] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGHEST for action security_group_members [ 871.630585] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGHEST for action security_group_members [ 871.630585] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGHEST for action security_group_members [ 871.630967] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.631132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.631256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.631526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.632420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.632420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.632420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.632420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.632420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.632420] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.633624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.633712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.633764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.633891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.634047] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.634166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.634241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.634407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.634537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.634585] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.635510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.635644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.635714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.635899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.636083] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.636238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.636311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.636463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.636547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.636637] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.081908] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 872.081908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.082404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.082404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.082535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.082652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.082813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.082951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.083050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.083139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.083305] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.083416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.083468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.083603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.083740] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.083833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.083893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.084041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.084115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.084193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.084280] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.138737] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.138943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.139020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.139261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.139385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.139613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.139729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.139817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.140089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.140217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.140359] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be updated. [ 872.141582] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.141695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.141762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.141937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.142090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.142267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.142362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.142424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.142603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.142687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.142775] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be updated. [ 872.143887] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.143995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.144074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.144237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.144325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.144526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.144622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.144683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.144826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.144903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.145007] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be updated. [ 872.179876] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.180096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.180096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.180315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.180543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.182530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.182676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.182760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.182999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.183069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.184820] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.184947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.185019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.185369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.185369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.197026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: IN_PROGRESS for 2s [ 872.197026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: IN_PROGRESS for 2s [ 872.197886] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: IN_PROGRESS for 2s [ 872.593154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08655f30-40a0-4bfa-8418-b72abb59f910: rpc.has_security_group_logging(os_id): False [ 872.610534] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.610534] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.610534] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.610534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.611101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.611101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.611101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.611101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.616193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.616282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.616462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.616570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.616687] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be created. [ 872.679625] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.684154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.684154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.684154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.684154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.702297] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 872.798510] env[69350]: INFO networking_nsxv3.common.synchronization [req-0e7c6b4e-384c-458c-9825-af85ef5a53cf req-e6275e05-4d96-4555-ba9d-a8e7fd21f0af tempest-ServerTagsTestJSON-1546690192 tempest-ServerTagsTestJSON-1546690192-project-member] Enqueued Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 872.799091] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 872.799415] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.799622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.799622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.799863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.800507] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.800697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.800757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.800891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.800968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.801085] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.862548] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 872.862548] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 deletion is rescheduled due to dependency. [ 872.862548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.250433] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.250433] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-702" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.250856] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-702" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.251105] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-702" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.251212] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.251375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.251520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.251800] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.251934] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.252174] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.252295] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.252433] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.252526] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.252639] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.253064] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.253064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.282978] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.283288] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.283479] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.283762] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-702" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.284607] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.284607] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.284607] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.284957] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.285077] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e2b9b8-c263-4095-9ef2-53fe591f9a0e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.305013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.305186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.305229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.305481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.305574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.305768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.305872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.305934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.306097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.306172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.306289] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 already deleted. [ 873.306330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.338529] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: SUCCESS [ 873.338872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.789075] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.789075] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.789075] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.789389] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.789543] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.789703] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 34e2b9b8-c263-4095-9ef2-53fe591f9a0e not found, creating... [ 873.789973] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.790149] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.790270] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.790557] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.790819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.790983] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.791268] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.791474] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.791634] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.791775] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.791918] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 34e2b9b8-c263-4095-9ef2-53fe591f9a0e is going to be created. [ 873.812594] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.812805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.812903] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.813227] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.813476] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.813710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.206078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a in Status: SUCCESS [ 874.206310] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a deletion is rescheduled due to dependency. [ 874.206478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.208486] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 in Status: SUCCESS [ 874.208687] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 deletion is rescheduled due to dependency. [ 874.208798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.209611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec in Status: SUCCESS [ 874.209788] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec deletion is rescheduled due to dependency. [ 874.209853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [req-0e7c6b4e-384c-458c-9825-af85ef5a53cf req-b5223f55-7ef9-4a36-a042-92681d1ae409 service nova] Enqueued Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_rules [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [req-0e7c6b4e-384c-458c-9825-af85ef5a53cf req-b5223f55-7ef9-4a36-a042-92681d1ae409 service nova] Enqueued Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [req-0e7c6b4e-384c-458c-9825-af85ef5a53cf req-b5223f55-7ef9-4a36-a042-92681d1ae409 service nova] Enqueued Resource ID: 34e2b9b8-c263-4095-9ef2-53fe591f9a0e with Priority: HIGHEST for action port [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_rules [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 874.613165] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e2b9b8-c263-4095-9ef2-53fe591f9a0e with Priority: HIGHEST for action port [ 874.614602] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.615014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.615255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.615703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.615921] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.617056] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.618147] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.618147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.618931] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.620311] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.620311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.620311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.620553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.620755] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e2b9b8-c263-4095-9ef2-53fe591f9a0e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.712597] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 874.712597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.712925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.713181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.713274] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.123484] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.124691] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.124691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.124946] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34e2b9b8-c263-4095-9ef2-53fe591f9a0e with status ACTIVE [ 875.125177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.125177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.125296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.125449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.125513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.125678] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.125744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.125835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.126098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.126187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.126396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.126500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.126554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.126694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.126763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.126848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34e2b9b8-c263-4095-9ef2-53fe591f9a0e is going to be updated. [ 875.153212] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.153212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.153212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.153212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.153587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.153587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34e2b9b8-c263-4095-9ef2-53fe591f9a0e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.215834] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.216289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.216450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.216750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.216825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.216918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.217013] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.630451] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.719174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.719384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.719433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.719641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.719811] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.719911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.719971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.720143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.720265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.720402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.720577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.720665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.720736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.720865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.721010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.721104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.721161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.721297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.721447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.721481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.721580] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.132687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.132923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.132999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.133250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.133340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.133449] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 is going to be created. [ 876.163344] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.163557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.163557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.163928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.164042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.174631] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: UNINITIALIZED for 2s [ 876.226028] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08655f30-40a0-4bfa-8418-b72abb59f910: rpc.has_security_group_logging(os_id): False [ 876.242675] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.242832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.242919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.243166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.243258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.243690] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.243690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.243690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.243933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.243933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.244174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.244267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.244325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.244573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.244573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.244797] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.244864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.244897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.245057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.245165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.245297] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be updated. [ 876.312859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.313041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.313091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.313297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.313459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.326523] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 877.277601] env[69350]: INFO networking_nsxv3.common.synchronization [req-3cfd6c52-b160-4934-ad01-ef500013a959 req-a2be6898-3f0e-48bc-ac26-9a703a002725 tempest-ImagesNegativeTestJSON-1300475273 tempest-ImagesNegativeTestJSON-1300475273-project-member] Enqueued Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 877.278376] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGHEST for action security_group_members [ 877.278549] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.278640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.278687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.278886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.280333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.280504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.280602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.280859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.280968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.281104] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.625879] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bc60cfb-a199-46c0-956a-0d2665722670 req-dfcdc040-e100-4dfe-8eb6-4cc1e4ead25b tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 877.625879] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 877.625879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.625879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.625879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.625879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.625879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.625879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.625879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.626597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.626832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.627045] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.783877] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.784089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.784143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.784416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.784416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.784600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.784800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.784929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.785117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.785198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.785290] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 is going to be updated. [ 877.816282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.816530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.816628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.816853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.817106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.827747] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: IN_PROGRESS for 2s [ 878.130336] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.188726] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: SUCCESS [ 878.189010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.189331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.189586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.189787] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.189907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.189973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.190153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.190256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.190319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.190404] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.338456] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 878.338456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.634338] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.694067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.694067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.694067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.694687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.694687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.694687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.694687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.694687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.694687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.694909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.694909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.694909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.695021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.695233] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.141985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.141985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.142130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.142275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.142425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.142540] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 879.175791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.175791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.175791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.175956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.176130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.199414] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 879.199414] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fd7257c-afd4-47d6-ae01-960d2d62dba1: rpc.has_security_group_logging(os_id): False [ 879.228483] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.228564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.228643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.228805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.228903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.229129] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.229238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.229849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.229849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.229849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.229849] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.229849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.229849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.230131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.230131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.230308] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.230400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.230520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.230708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.230782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.230869] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 is going to be created. [ 879.308453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.308662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.308662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.308904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.309111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.326511] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: IN_PROGRESS for 2s [ 879.839619] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 in Status: SUCCESS [ 879.839884] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 deletion is rescheduled due to dependency. [ 879.840071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.096987] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.097375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.097516] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.098044] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.098179] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.098355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.098487] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.098787] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.098941] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.099210] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.099684] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.099832] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.099950] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.100178] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.100304] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.100474] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.122929] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.123161] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.123161] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.124191] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.124191] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9f80b973-7124-44d9-acbe-0dff3054e787 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.124191] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.124191] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.124430] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.124648] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f80b973-7124-44d9-acbe-0dff3054e787',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.627669] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.628873] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.628873] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.628873] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.628873] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.628873] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.629385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.629555] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.629796] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.629935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.630264] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.630416] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.630645] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.630808] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.630944] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.631099] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9f80b973-7124-44d9-acbe-0dff3054e787 is going to be updated. [ 880.656046] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.656321] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.656464] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.656775] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.656985] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.657245] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.211164] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 881.211724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.343025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: SUCCESS [ 881.343025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.728449] env[69350]: INFO networking_nsxv3.common.synchronization [req-60afc32b-73dc-4f38-8307-01e6f0959d4a req-70fd003a-b709-417d-a7b6-01ab2a1eff2f service nova] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 881.728650] env[69350]: INFO networking_nsxv3.common.synchronization [req-60afc32b-73dc-4f38-8307-01e6f0959d4a req-70fd003a-b709-417d-a7b6-01ab2a1eff2f service nova] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 881.728798] env[69350]: INFO networking_nsxv3.common.synchronization [req-60afc32b-73dc-4f38-8307-01e6f0959d4a req-70fd003a-b709-417d-a7b6-01ab2a1eff2f service nova] Enqueued Resource ID: 9f80b973-7124-44d9-acbe-0dff3054e787 with Priority: HIGHEST for action port [ 881.729050] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_rules [ 881.729192] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 881.729289] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f80b973-7124-44d9-acbe-0dff3054e787 with Priority: HIGHEST for action port [ 881.730193] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.730193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.731634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.731634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.731634] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.735707] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.735707] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.735707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.735707] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.736430] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f80b973-7124-44d9-acbe-0dff3054e787 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.736430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.736430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.736604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.736741] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f80b973-7124-44d9-acbe-0dff3054e787',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.240777] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.241099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.241196] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.242132] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f80b973-7124-44d9-acbe-0dff3054e787 with status ACTIVE [ 882.242339] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.242455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.242523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.242737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.242849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.243063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.243182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.243261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.243451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.246869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.247205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.247391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.247535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.247783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.247919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.248062] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f80b973-7124-44d9-acbe-0dff3054e787 is going to be updated. [ 882.273097] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.273629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.273734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.273973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.274202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.274324] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f80b973-7124-44d9-acbe-0dff3054e787" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.751969] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.238112] env[69350]: INFO networking_nsxv3.common.synchronization [req-26899cd2-b706-439a-9670-b4d26f6245d1 req-015869ad-5de3-4167-801f-2e66bb279bb2 tempest-FloatingIPsAssociationTestJSON-45960377 tempest-FloatingIPsAssociationTestJSON-45960377-project-member] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 883.239328] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 883.240130] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.240274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.240340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.240626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.240789] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.241102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.241102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.242152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.242152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.242152] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.253871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.254075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.254285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.254432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.254509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.254544] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be updated. [ 883.284548] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.284736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.284814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.285258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.285258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.297262] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c96c6dbe-c9f3-45d9-a629-84de38246e0e None None] Enqueued Resource ID: ae2f76a2-78c7-4569-b78e-bc38d24975a4 with Priority: HIGHEST for action port [ 883.297262] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae2f76a2-78c7-4569-b78e-bc38d24975a4 with Priority: HIGHEST for action port [ 883.297262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae2f76a2-78c7-4569-b78e-bc38d24975a4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.297262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae2f76a2-78c7-4569-b78e-bc38d24975a4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.297262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae2f76a2-78c7-4569-b78e-bc38d24975a4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.297262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae2f76a2-78c7-4569-b78e-bc38d24975a4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.297262] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae2f76a2-78c7-4569-b78e-bc38d24975a4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.311355] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: IN_PROGRESS for 2s [ 883.697523] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.699801] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.699801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.699801] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.699801] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.700924] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.700924] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.700924] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.700924] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.700924] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.734340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.734516] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.734664] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.734901] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.735489] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c616cd6c-6468-4a97-a29a-40a206911053 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.735718] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.735936] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.736365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.736516] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c616cd6c-6468-4a97-a29a-40a206911053',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.744296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.744480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.744541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.744733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.744802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.744994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.745195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.745274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.745541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.745541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.745690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e already deleted. [ 883.745690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.800232] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae2f76a2-78c7-4569-b78e-bc38d24975a4 [ 883.800905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.801273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.802096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.802096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.802096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.802096] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae2f76a2-78c7-4569-b78e-bc38d24975a4 already deleted. [ 883.802096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae2f76a2-78c7-4569-b78e-bc38d24975a4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.239728] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.240027] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.240161] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.240475] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.240736] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.240920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c616cd6c-6468-4a97-a29a-40a206911053 not found, creating... [ 884.241271] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.241489] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.241694] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.241974] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.242141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.242448] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.242623] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.242750] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.243046] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.243136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.243318] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c616cd6c-6468-4a97-a29a-40a206911053 is going to be created. [ 884.275650] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.275650] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.275805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.276589] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.276589] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.276758] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.030189] env[69350]: INFO networking_nsxv3.common.synchronization [req-26899cd2-b706-439a-9670-b4d26f6245d1 req-c2c7913e-f859-4726-b1b0-d0f5ed5f4779 service nova] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_rules [ 885.030384] env[69350]: INFO networking_nsxv3.common.synchronization [req-26899cd2-b706-439a-9670-b4d26f6245d1 req-c2c7913e-f859-4726-b1b0-d0f5ed5f4779 service nova] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 885.031479] env[69350]: INFO networking_nsxv3.common.synchronization [req-26899cd2-b706-439a-9670-b4d26f6245d1 req-c2c7913e-f859-4726-b1b0-d0f5ed5f4779 service nova] Enqueued Resource ID: c616cd6c-6468-4a97-a29a-40a206911053 with Priority: HIGHEST for action port [ 885.031479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_rules [ 885.031479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 885.031479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c616cd6c-6468-4a97-a29a-40a206911053 with Priority: HIGHEST for action port [ 885.033769] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.033929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.034030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.037162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.037162] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.037162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.037162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.037162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.037162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.037162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.037162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.037571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.037571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.037571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.037680] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.040301] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c616cd6c-6468-4a97-a29a-40a206911053 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.040470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.040470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.040713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.040797] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c616cd6c-6468-4a97-a29a-40a206911053',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.322597] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: SUCCESS [ 885.322920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.323128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.323343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.323549] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.323679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.323755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.323922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.324007] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.324096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.324195] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.543468] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.544678] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.544936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547902] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c616cd6c-6468-4a97-a29a-40a206911053 with status ACTIVE [ 885.547902] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.547902] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.547902] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.547902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.547902] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c616cd6c-6468-4a97-a29a-40a206911053 is going to be updated. [ 885.577217] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.577217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.577217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.577763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.577763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.577879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c616cd6c-6468-4a97-a29a-40a206911053" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.750380] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6c38cb1a-c102-40dd-89a1-9f6c8b56b901 None None] Enqueued Resource ID: 4cab9c83-5b26-46d6-b86a-fb07819e0e84 with Priority: HIGHEST for action port [ 885.750380] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cab9c83-5b26-46d6-b86a-fb07819e0e84 with Priority: HIGHEST for action port [ 885.750837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cab9c83-5b26-46d6-b86a-fb07819e0e84 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.751164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cab9c83-5b26-46d6-b86a-fb07819e0e84" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.751420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cab9c83-5b26-46d6-b86a-fb07819e0e84" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.751806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cab9c83-5b26-46d6-b86a-fb07819e0e84" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.753112] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cab9c83-5b26-46d6-b86a-fb07819e0e84',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.828235] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.046488] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.254469] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cab9c83-5b26-46d6-b86a-fb07819e0e84 [ 886.254812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.254971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.255091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.255308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.255424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.255527] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cab9c83-5b26-46d6-b86a-fb07819e0e84 already deleted. [ 886.255625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cab9c83-5b26-46d6-b86a-fb07819e0e84" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.331479] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9657ac2-98f3-4bb3-988b-9e7555afd46b: rpc.has_security_group_logging(os_id): False [ 886.353139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.353389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.353539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.353771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.353956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.354350] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.354576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.354576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.354725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.354725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.354845] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be created. [ 886.438640] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.438877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.438877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.439235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.439356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.466039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: IN_PROGRESS for 2s [ 886.553319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.553319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.553319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.553703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.553703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.553703] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be created. [ 886.602893] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.603080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.603147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.603424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.603539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.615899] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: UNINITIALIZED for 2s [ 887.820565] env[69350]: INFO networking_nsxv3.common.synchronization [req-00166d01-f0f5-4116-80a4-c84d7b2ff057 req-ad229cf1-1f5b-4b51-bd5f-2839be08cf0b tempest-ServerTagsTestJSON-1546690192 tempest-ServerTagsTestJSON-1546690192-project-member] Enqueued Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 887.820565] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGHEST for action security_group_members [ 887.820565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.820565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.820565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.822371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.822371] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.822371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.822371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.822371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.823083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.823083] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.325100] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.325332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.325332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.325546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.325643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.325844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.328159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.328298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.328578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.328694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.328825] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 is going to be updated. [ 888.332955] env[69350]: INFO networking_nsxv3.common.synchronization [req-ddecb9a5-8bf6-4b86-bbf6-25049bba96ad req-f477cd3d-b58c-4d44-8606-6313db316763 tempest-ServerRescueTestJSON-370583535 tempest-ServerRescueTestJSON-370583535-project-member] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 888.334669] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGHEST for action security_group_members [ 888.334989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.335185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.335231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.335453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.335624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.335757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.335845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.336060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.336155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.336252] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.395591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.395980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.395980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.396225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.396405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.411116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: IN_PROGRESS for 2s [ 888.446735] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e67fe04-b1e0-4967-accb-46371cb1c551 req-e13bc7c6-d4e4-4f5f-895c-910d2d3ebaef tempest-ServersNegativeTestJSON-814899616 tempest-ServersNegativeTestJSON-814899616-project-member] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 888.447516] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 888.447867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.447988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.448597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.448897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.449110] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.449231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.449297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.450563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.450563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.450563] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.481109] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: SUCCESS [ 888.481590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.631283] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 888.631525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.632250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.632561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.632803] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.632925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.633021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.633395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.633395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.633395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.633599] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.841121] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.841121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.841121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.841121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.865631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.865631] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.865631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.865631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.866053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.866053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.866053] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be updated. [ 888.895797] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-543 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.896205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.896585] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.896807] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.898574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.898987] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.899204] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.899441] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.899566] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.899683] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.899800] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.899946] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.900074] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.900219] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.903097] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.903429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.903578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.903798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.903978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.918189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: IN_PROGRESS for 2s [ 888.929093] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.929305] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.929528] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.929664] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.930119] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-7a79c52a-a307-43ac-bcb4-c636de094b1a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.930277] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.930447] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.930909] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.931965] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a79c52a-a307-43ac-bcb4-c636de094b1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.953102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.953102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.953298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.954045] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.954045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.954418] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 already deleted. [ 888.954418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.137514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.137791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.137791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.137970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.138123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.138263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.138340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.138476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.138565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.138660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.138814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.138924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.139018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.139112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.139249] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.139348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.139415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.139829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.139829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.139829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.139829] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.433940] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.434213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.434353] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.434665] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.434823] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.434985] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 7a79c52a-a307-43ac-bcb4-c636de094b1a not found, creating... [ 889.435279] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.435492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.435582] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.436614] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.436614] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.436614] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.436614] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.436614] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.436927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.436927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.437055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a is going to be created. [ 889.458548] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.458820] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.458952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.459256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.459493] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.459729] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.642487] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e075408-82f5-4e52-84f7-426a04568f7e: rpc.has_security_group_logging(os_id): False [ 889.667282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.667483] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.667527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.667738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.667831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.668061] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.668190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.668229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.669033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.669033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.669033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.669033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.669033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.669359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.669359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.669359] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.669475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.669520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.669674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.669739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.669789] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be created. [ 889.740729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.740953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.740999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.741229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.741420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.753533] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 890.265444] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e67fe04-b1e0-4967-accb-46371cb1c551 req-be26f8b4-3c51-497e-b89e-d94d68de11ec service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 890.265863] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e67fe04-b1e0-4967-accb-46371cb1c551 req-be26f8b4-3c51-497e-b89e-d94d68de11ec service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 890.265863] env[69350]: INFO networking_nsxv3.common.synchronization [req-9e67fe04-b1e0-4967-accb-46371cb1c551 req-be26f8b4-3c51-497e-b89e-d94d68de11ec service nova] Enqueued Resource ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a with Priority: HIGHEST for action port [ 890.266027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 890.268027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 890.268027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a with Priority: HIGHEST for action port [ 890.268027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.268027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.268027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.268027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.268027] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.268954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.269084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.269149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.269410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.269676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.269676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.269855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.269990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.269990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.270149] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.271611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a79c52a-a307-43ac-bcb4-c636de094b1a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.271611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.271611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.271611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.271611] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a79c52a-a307-43ac-bcb4-c636de094b1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.423888] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 in Status: SUCCESS [ 890.424137] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 deletion is rescheduled due to dependency. [ 890.424221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.773605] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.774623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.774743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.775977] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a79c52a-a307-43ac-bcb4-c636de094b1a with status ACTIVE [ 890.775977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.778852] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.778852] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.778852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.778852] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a is going to be updated. [ 890.812405] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.812654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.813676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.813676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.813676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.813676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.933117] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdbb2071-5801-4662-9a75-aa174ebd2139 in Status: SUCCESS [ 890.933324] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 deletion is rescheduled due to dependency. [ 890.933445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.280448] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.768554] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 891.768554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.782816] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.782983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.783141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.783445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.783664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.783726] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be created. [ 891.808644] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.808865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.808940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.809216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.809388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.822585] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: UNINITIALIZED for 2s [ 893.838308] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 893.838666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.838887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.839107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.839315] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.839429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.839504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.839731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.839834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.839924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.840146] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.342869] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.344276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.344406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.344555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.344839] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.344936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.344936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.345114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.345205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.345293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.345450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.345543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.345636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.345747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.345921] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.346186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.346253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.346405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.346486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.346581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.346659] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.851402] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac836d8b-740c-4a34-ae58-041041eb8e77: rpc.has_security_group_logging(os_id): False [ 894.884363] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.884608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.884608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.884800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.884907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.885171] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.885313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.885382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.885511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.885592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.885791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.886057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.886057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.886182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.886232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.886450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.887066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.887066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.887066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.887066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.887066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be created. [ 894.981455] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.981732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.981865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.982200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.982400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.002237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 895.267363] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 895.267668] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 897.020500] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 897.021571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.490133] env[69350]: INFO networking_nsxv3.common.synchronization [req-4fa04379-1902-4ee9-b43f-43cbf7decc4c req-2d6b14a8-15c2-418e-95da-b5fd6934e877 tempest-InstanceActionsV221TestJSON-932736357 tempest-InstanceActionsV221TestJSON-932736357-project-member] Enqueued Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 898.490807] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 898.491374] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.491652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.491760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.492189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.492354] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.492479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.492548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.492745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.492834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.492932] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.836548] env[69350]: INFO networking_nsxv3.common.synchronization [req-73c417be-1878-46ad-a670-245f8875e41c req-61a67cff-4b69-47bf-b88b-f1650a010d68 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 898.838020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 898.839074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.839074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.839074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.839074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.839074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.839074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.839074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.839747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.839747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.839747] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.997067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.997245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.997318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.998761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.998761] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f already deleted. [ 898.998761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.311482] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.313036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-856" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.313036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-856" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.313216] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-856" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.313552] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.313872] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314033] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.314344] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.314621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.314878] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.315010] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.315138] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.315332] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.315547] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.315677] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.315821] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.339945] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.340184] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.340385] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.341170] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-856" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.341170] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-8f787415-71f2-4121-bf4b-8361172a3f45 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.341410] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.341596] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.341957] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.342668] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f787415-71f2-4121-bf4b-8361172a3f45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.344796] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.348024] env[69350]: INFO networking_nsxv3.common.synchronization [req-e8a64f4e-9159-42fe-8d05-8f8288bb5dd4 req-4091fa66-196a-471a-9a2f-4da120011377 tempest-ListServersNegativeTestJSON-1137733051 tempest-ListServersNegativeTestJSON-1137733051-project-member] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 899.348715] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGHEST for action security_group_members [ 899.348807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.348906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.845648] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.846080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.846080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.846386] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.846579] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.846832] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 8f787415-71f2-4121-bf4b-8361172a3f45 not found, creating... [ 899.847355] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.847617] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.847826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.848223] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.848468] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.848875] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.849064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.849193] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.849503] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.849674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.849828] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 8f787415-71f2-4121-bf4b-8361172a3f45 is going to be created. [ 899.851250] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.880567] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.880859] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.880957] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.881276] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.881518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.882095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.355393] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.355393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.355579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.355674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.357055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.357055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 900.390919] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.390919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.391071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.391823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.391823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.402228] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 900.767687] env[69350]: INFO networking_nsxv3.common.synchronization [req-4fa04379-1902-4ee9-b43f-43cbf7decc4c req-e14d0899-46df-4695-8626-28425a2e2623 service nova] Enqueued Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_rules [ 900.769928] env[69350]: INFO networking_nsxv3.common.synchronization [req-4fa04379-1902-4ee9-b43f-43cbf7decc4c req-e14d0899-46df-4695-8626-28425a2e2623 service nova] Enqueued Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 900.770153] env[69350]: INFO networking_nsxv3.common.synchronization [req-4fa04379-1902-4ee9-b43f-43cbf7decc4c req-e14d0899-46df-4695-8626-28425a2e2623 service nova] Enqueued Resource ID: 8f787415-71f2-4121-bf4b-8361172a3f45 with Priority: HIGHEST for action port [ 900.770757] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_rules [ 900.770919] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 900.772269] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f787415-71f2-4121-bf4b-8361172a3f45 with Priority: HIGHEST for action port [ 900.773727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.773951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.773951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.774227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.775617] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.778995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.778995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.778995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.779393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.779393] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.779393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.779393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.779645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.779645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.779748] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.782586] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f787415-71f2-4121-bf4b-8361172a3f45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.782586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.782586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.782586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.782586] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f787415-71f2-4121-bf4b-8361172a3f45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.282282] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.283678] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.283884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.285398] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f787415-71f2-4121-bf4b-8361172a3f45 with status ACTIVE [ 901.285707] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.285707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.285855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.285947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.286053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.286236] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.286326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.286390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.286507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.286582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.286747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.286926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.286926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.287146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.287146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.287262] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f787415-71f2-4121-bf4b-8361172a3f45 is going to be updated. [ 901.313075] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.313245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.313358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.313507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.313644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.313807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f787415-71f2-4121-bf4b-8361172a3f45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.785791] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.295707] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.295707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.295707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.295707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.295707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.295707] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f is going to be created. [ 902.317624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.317624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.317624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.317624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.317624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.332464] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: UNINITIALIZED for 2s [ 902.417523] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 902.418221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.419067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.419379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.419613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.419760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.419832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.424084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.424364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.424494] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.927859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.928787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.930451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.930707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.930850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.931115] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.931275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.931351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.931533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.931617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.931728] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be updated. [ 902.960399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.960590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.960675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.961093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.961293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.971557] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: IN_PROGRESS for 2s [ 903.498596] env[69350]: INFO networking_nsxv3.common.synchronization [req-81a727c5-d797-474b-88e2-180fc5d889fd req-4abbdc1f-d971-44d9-ab03-61bb440821c1 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 903.499199] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 903.499546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.499671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.499740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.500008] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.501158] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.501271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.503136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.503383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.503503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.503615] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.762120] env[69350]: INFO networking_nsxv3.common.synchronization [None req-53e1a53d-0714-4cfc-b2b6-8aa7e6c2b9fe None None] Enqueued Resource ID: 471e003b-2ce7-4b27-8f5b-04ced0b350ea with Priority: HIGHEST for action port [ 903.762120] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471e003b-2ce7-4b27-8f5b-04ced0b350ea with Priority: HIGHEST for action port [ 903.764812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-471e003b-2ce7-4b27-8f5b-04ced0b350ea taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-471e003b-2ce7-4b27-8f5b-04ced0b350ea" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-471e003b-2ce7-4b27-8f5b-04ced0b350ea" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.765512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-471e003b-2ce7-4b27-8f5b-04ced0b350ea" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.765637] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('471e003b-2ce7-4b27-8f5b-04ced0b350ea',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.009388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.009388] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.009388] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 already deleted. [ 904.009388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.159279] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.160571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.160571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.164021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.164021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.164021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.164021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.164021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.164021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.164021] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.164021] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.164021] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.164021] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.164021] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.164021] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.164021] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.192111] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.192111] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.192111] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.192111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.192111] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-d2691c24-a298-4824-baae-f1ee586eab41 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.192111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.192111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.192111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.192111] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2691c24-a298-4824-baae-f1ee586eab41',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.272296] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 471e003b-2ce7-4b27-8f5b-04ced0b350ea [ 904.272296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.272296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.272296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.272296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.272296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.272296] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:471e003b-2ce7-4b27-8f5b-04ced0b350ea already deleted. [ 904.272296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-471e003b-2ce7-4b27-8f5b-04ced0b350ea" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.347356] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: SUCCESS [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.349650] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.349650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.349650] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.696424] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.696744] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.697041] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.697368] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.697586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.697814] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port d2691c24-a298-4824-baae-f1ee586eab41 not found, creating... [ 904.698194] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.698412] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.698576] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.698919] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.699110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.699429] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.699595] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.699715] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.699947] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.700101] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.700249] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: d2691c24-a298-4824-baae-f1ee586eab41 is going to be created. [ 904.726029] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.726430] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.726665] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.727368] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.727655] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.728487] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.851995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.852320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.852356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.852655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852848] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.852956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.853051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.853278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.853278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.854053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.854053] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.854053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.854053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.854166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.854389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.854444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.854481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.854610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.854706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.854787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.854874] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.983732] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 in Status: SUCCESS [ 904.983919] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 deletion is rescheduled due to dependency. [ 904.984053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.356994] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f: rpc.has_security_group_logging(os_id): False [ 905.380573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.381047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.381047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.381227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.381258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.381440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.383073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.383073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.383073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.383073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.387026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.387026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.387026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.387026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f is going to be created. [ 905.460334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.462366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.462446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.462688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.464017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.477363] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: IN_PROGRESS for 2s [ 905.579577] env[69350]: INFO networking_nsxv3.common.synchronization [req-81a727c5-d797-474b-88e2-180fc5d889fd req-a74961c0-26f2-46ff-8cf9-8d7b42b34ea5 service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 905.579776] env[69350]: INFO networking_nsxv3.common.synchronization [req-81a727c5-d797-474b-88e2-180fc5d889fd req-a74961c0-26f2-46ff-8cf9-8d7b42b34ea5 service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 905.579921] env[69350]: INFO networking_nsxv3.common.synchronization [req-81a727c5-d797-474b-88e2-180fc5d889fd req-a74961c0-26f2-46ff-8cf9-8d7b42b34ea5 service nova] Enqueued Resource ID: d2691c24-a298-4824-baae-f1ee586eab41 with Priority: HIGHEST for action port [ 905.580515] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 905.580660] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 905.580765] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2691c24-a298-4824-baae-f1ee586eab41 with Priority: HIGHEST for action port [ 905.581172] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.581327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.581377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.581582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.581663] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.582932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.583195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.583291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.583486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.583652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.583755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.583820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.583970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.584075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.584172] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.585218] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2691c24-a298-4824-baae-f1ee586eab41 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.585331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.585443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.585549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.585622] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2691c24-a298-4824-baae-f1ee586eab41',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.748104] env[69350]: INFO networking_nsxv3.common.synchronization [None req-056d9acc-ab86-47e9-8d46-af2056204b55 None None] Enqueued Resource ID: df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4 with Priority: HIGHEST for action port [ 905.748767] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4 with Priority: HIGHEST for action port [ 905.749264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.749366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.749414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.749683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.749756] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.086937] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1c901a1-d33a-45c0-bd86-60e0bbc40c26 req-71160f44-4bfc-4450-a93c-c3ce7ed99fb6 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 906.086937] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 906.086937] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.086937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.090361] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.090977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.090977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.091451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.091831] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.092040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.092146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.092702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.092831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.093042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.096383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2691c24-a298-4824-baae-f1ee586eab41 with status ACTIVE [ 906.096383] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.096383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.096383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.096383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.096383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.096659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.096712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.096767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.097039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.097156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.097424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.097575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.097750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.097989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.098115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.098229] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2691c24-a298-4824-baae-f1ee586eab41 is going to be updated. [ 906.099840] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.132197] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.132372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.132407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.133301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.133301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.133301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2691c24-a298-4824-baae-f1ee586eab41" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.255318] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4 [ 906.255673] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.255880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.255880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.256158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.256352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.256395] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4 already deleted. [ 906.256456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df68fa0c-96c3-48f2-b92c-bbb6cb0e43f4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.549326] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.549548] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.549680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.549964] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.550306] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.550516] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.550642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.550971] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.552226] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.552463] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.552590] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.554886] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.554993] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.555140] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.555257] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.555402] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.574376] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.574477] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.574652] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.574890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.575233] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.575426] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.575556] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.575958] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.576136] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edb57e3b-c8a2-472b-a1b0-4841d0d595e3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.602244] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.603436] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.603562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.603628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.603843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.603969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.604210] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.604312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.604375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.604527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.604601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.604684] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e already deleted. [ 906.604772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.078535] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.078968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.079124] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.079485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.079710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.079899] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port edb57e3b-c8a2-472b-a1b0-4841d0d595e3 not found, creating... [ 907.080218] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.080452] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.080611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.081201] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.081201] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.081585] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.081982] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.082211] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.082553] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.082806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.083041] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: edb57e3b-c8a2-472b-a1b0-4841d0d595e3 is going to be created. [ 907.107287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.107516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.107610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.108016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.108155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.108313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be created. [ 907.111076] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.111338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.111470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.111783] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.112129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.112450] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.149952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.150157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.150245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.150542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.150772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.165349] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: UNINITIALIZED for 2s [ 907.501339] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: SUCCESS [ 907.501571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.880201] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1c901a1-d33a-45c0-bd86-60e0bbc40c26 req-253229e3-93da-4f3a-858a-6d5cac485dc9 service nova] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 907.880586] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1c901a1-d33a-45c0-bd86-60e0bbc40c26 req-253229e3-93da-4f3a-858a-6d5cac485dc9 service nova] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 907.880915] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1c901a1-d33a-45c0-bd86-60e0bbc40c26 req-253229e3-93da-4f3a-858a-6d5cac485dc9 service nova] Enqueued Resource ID: edb57e3b-c8a2-472b-a1b0-4841d0d595e3 with Priority: HIGHEST for action port [ 907.881645] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_rules [ 907.881863] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 907.882042] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb57e3b-c8a2-472b-a1b0-4841d0d595e3 with Priority: HIGHEST for action port [ 907.882343] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.882467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.882534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.882751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.882839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.883906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.883995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.884059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.884265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884421] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.884521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.884582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.884731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.884912] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.885807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.885931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.885977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.886628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.886628] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edb57e3b-c8a2-472b-a1b0-4841d0d595e3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.389469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.389469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.389469] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.390623] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edb57e3b-c8a2-472b-a1b0-4841d0d595e3 with status ACTIVE [ 908.390623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.390623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.390623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.390992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.390992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.391122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.391291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.391381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.391822] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.391822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.391822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.391981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.391981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.392066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edb57e3b-c8a2-472b-a1b0-4841d0d595e3 is going to be updated. [ 908.423629] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.423629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.423629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.424019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.424019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.424019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edb57e3b-c8a2-472b-a1b0-4841d0d595e3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.897131] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.182603] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 909.182872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.183012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.183254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.183439] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.183558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.183624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.183852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.183946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.184041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.184134] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.401748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.402227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.402227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.402885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.402885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.402885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e is going to be created. [ 909.440378] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.440561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.441333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.441333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.441333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.453508] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: UNINITIALIZED for 2s [ 909.686635] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.190783] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 935f66d0-48ab-44a6-9d44-d9c84d53af88: rpc.has_security_group_logging(os_id): False [ 910.212888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.212888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.212888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.212888] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be created. [ 910.440332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.440692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.440692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.440815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.441106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.454931] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 911.468107] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: SUCCESS [ 911.468371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.468510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.468739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.468929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.469059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.469117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.469267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.469345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.469428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.469516] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.540276] env[69350]: INFO networking_nsxv3.common.synchronization [req-50656899-da79-41b5-a8ce-a4e7d0cf4436 req-85f08180-c2f4-43df-aa3c-ac5db600c566 tempest-ServerMetadataNegativeTestJSON-1700653367 tempest-ServerMetadataNegativeTestJSON-1700653367-project-member] Enqueued Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 911.540902] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 911.541272] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.541404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.541473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.541795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.541967] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.542108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.542135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.542308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.542394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.542489] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.972442] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.977167] env[69350]: INFO networking_nsxv3.common.synchronization [req-5e5ab7f8-7836-4d39-b5c3-23ce5899b385 req-335ff319-4585-45e2-9565-b6a05c97a6fe tempest-InstanceActionsV221TestJSON-932736357 tempest-InstanceActionsV221TestJSON-932736357-project-member] Enqueued Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 911.977167] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGHEST for action security_group_members [ 911.977406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.977406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.977567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.977650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.977800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.977888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.977952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.978122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.978205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.978295] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.046425] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.046591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.046670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.046887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.046980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.047484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.047484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.047484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.047786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.047786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.047786] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f already deleted. [ 912.047940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.127355] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-212" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-212" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-212" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.127355] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.127355] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.127355] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.127355] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.127862] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.127862] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.127862] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.127862] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.127986] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.151668] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.151954] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 912.152138] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.152350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-212" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.152722] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-bf6a6d59-ee96-45fb-b948-6887ced0f62c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.152981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.153199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.153527] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.153784] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf6a6d59-ee96-45fb-b948-6887ced0f62c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.469151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 912.469413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.474779] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30d7c80b-0893-40cf-bbe9-c943f87b4d3e: rpc.has_security_group_logging(os_id): False [ 912.479991] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.480142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.480142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.480400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.480511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.480766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.480917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.480991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.481194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.481309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.481381] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f is going to be updated. [ 912.496052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.496052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.496052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.496052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.496308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.496404] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.496834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.496834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.496834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.496834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.497063] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e is going to be created. [ 912.519816] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.520046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.520046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.520261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.520405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.529879] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: IN_PROGRESS for 2s [ 912.563274] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.563428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.563501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.563722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.563913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.579825] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: IN_PROGRESS for 2s [ 912.656510] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.656757] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.656887] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.657224] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.657386] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.657550] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port bf6a6d59-ee96-45fb-b948-6887ced0f62c not found, creating... [ 912.657829] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.657997] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.658145] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.658385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.658525] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.658825] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.659079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.659289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.659540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.659683] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.659830] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: bf6a6d59-ee96-45fb-b948-6887ced0f62c is going to be created. [ 912.684015] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.684258] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.684489] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.684911] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.685286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.685650] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.586645] env[69350]: INFO networking_nsxv3.common.synchronization [req-50656899-da79-41b5-a8ce-a4e7d0cf4436 req-ad19ecbe-182a-4ea7-b228-608015d818eb service nova] Enqueued Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_rules [ 913.586645] env[69350]: INFO networking_nsxv3.common.synchronization [req-50656899-da79-41b5-a8ce-a4e7d0cf4436 req-ad19ecbe-182a-4ea7-b228-608015d818eb service nova] Enqueued Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 913.586645] env[69350]: INFO networking_nsxv3.common.synchronization [req-50656899-da79-41b5-a8ce-a4e7d0cf4436 req-ad19ecbe-182a-4ea7-b228-608015d818eb service nova] Enqueued Resource ID: bf6a6d59-ee96-45fb-b948-6887ced0f62c with Priority: HIGHEST for action port [ 913.588695] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_rules [ 913.588695] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 913.588973] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6a6d59-ee96-45fb-b948-6887ced0f62c with Priority: HIGHEST for action port [ 913.589437] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.590198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.590198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.590198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.590198] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.591335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.591528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.591692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.592760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.592760] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.592760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.592760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.592760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.592760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.592760] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.593745] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf6a6d59-ee96-45fb-b948-6887ced0f62c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.593893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.594655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.594655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.594655] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf6a6d59-ee96-45fb-b948-6887ced0f62c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.098323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.098323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.098323] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.099913] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf6a6d59-ee96-45fb-b948-6887ced0f62c with status ACTIVE [ 914.100209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.100427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.100522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.100746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.100847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.101301] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.101421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.101471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.101697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.101785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.102178] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.102318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.102387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.102712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.102861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.103357] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf6a6d59-ee96-45fb-b948-6887ced0f62c is going to be updated. [ 914.135870] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.136022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.136117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.136362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.136906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.136906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf6a6d59-ee96-45fb-b948-6887ced0f62c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.542492] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f in Status: SUCCESS [ 914.542721] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f deletion is rescheduled due to dependency. [ 914.542817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.592353] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: SUCCESS [ 914.592661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.605956] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.108768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.108972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.109193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.109290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.109381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.109481] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f is going to be created. [ 915.142023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.142023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.142023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.142023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.142023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.152319] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: UNINITIALIZED for 2s [ 917.164155] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: SUCCESS [ 917.164587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.164587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.678737] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.678840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.678899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.679115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.679286] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.679395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.679657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.679657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.679778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.679822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.679976] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.680102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.680166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.680316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.680452] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.680544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.680604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.680738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.680814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.680965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.681057] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.187359] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd9e37a4-5f26-4f1d-91f1-8a66db647d9f: rpc.has_security_group_logging(os_id): False [ 918.209669] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.213020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.213020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.213020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.213530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.213530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.213530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.213530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.217022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.217022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f is going to be created. [ 918.291020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.291020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.291020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.291020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.291020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.306316] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: IN_PROGRESS for 2s [ 918.591742] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 918.592073] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 919.270453] env[69350]: INFO networking_nsxv3.common.synchronization [req-9401fa1e-88fb-4ff1-b6ce-7b23af0ececa req-9912132a-99ab-4554-81ce-d5f866111d1a tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 919.274619] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 919.280070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.280070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.280070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.280070] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.784203] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.784203] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.784203] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c already deleted. [ 919.784203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.875030] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.875217] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.877059] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.877059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.877059] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.877059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.877059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.877487] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.877487] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.877648] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.877829] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.902289] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.902289] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.902289] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.902289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-433" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.902289] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-f4335ae2-ca25-40a1-97b1-512d03a99b27 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.902289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.902289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.902289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.902289] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4335ae2-ca25-40a1-97b1-512d03a99b27',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.321987] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: SUCCESS [ 920.322460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.404834] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.405158] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.405435] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.405783] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.406037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.406721] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port f4335ae2-ca25-40a1-97b1-512d03a99b27 not found, creating... [ 920.406721] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.406937] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.407790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.407790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.407790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.408016] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.408220] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.408353] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.408634] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.408782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.408979] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: f4335ae2-ca25-40a1-97b1-512d03a99b27 is going to be created. [ 920.430198] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.430578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.430831] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.431340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.431743] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.432261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.540291] env[69350]: INFO networking_nsxv3.common.synchronization [req-9401fa1e-88fb-4ff1-b6ce-7b23af0ececa req-d2d19135-3aae-4618-a61f-f2973bb85120 service nova] Enqueued Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_rules [ 921.541178] env[69350]: INFO networking_nsxv3.common.synchronization [req-9401fa1e-88fb-4ff1-b6ce-7b23af0ececa req-d2d19135-3aae-4618-a61f-f2973bb85120 service nova] Enqueued Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 921.541178] env[69350]: INFO networking_nsxv3.common.synchronization [req-9401fa1e-88fb-4ff1-b6ce-7b23af0ececa req-d2d19135-3aae-4618-a61f-f2973bb85120 service nova] Enqueued Resource ID: f4335ae2-ca25-40a1-97b1-512d03a99b27 with Priority: HIGHEST for action port [ 921.541178] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_rules [ 921.541178] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 921.541836] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4335ae2-ca25-40a1-97b1-512d03a99b27 with Priority: HIGHEST for action port [ 921.542723] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.542866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.542960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.543897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.543897] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.544634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.544746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.544806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.544988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.545953] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.546441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.546441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.546441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.546441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.550232] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.550232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4335ae2-ca25-40a1-97b1-512d03a99b27 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.550232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.550232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.550232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.550232] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4335ae2-ca25-40a1-97b1-512d03a99b27',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.049514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.049770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.051282] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.052848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4335ae2-ca25-40a1-97b1-512d03a99b27 with status ACTIVE [ 922.053391] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.053621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.054047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.054047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.054152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.056095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.056095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.056095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.056095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4335ae2-ca25-40a1-97b1-512d03a99b27 is going to be updated. [ 922.060073] env[69350]: INFO networking_nsxv3.common.synchronization [None req-79ea379a-099c-4540-b948-d8e3effab9f7 None None] Enqueued Resource ID: 4664b2d0-713d-4ef5-b8b6-70b094cf9903 with Priority: HIGHEST for action port [ 922.061674] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4664b2d0-713d-4ef5-b8b6-70b094cf9903 with Priority: HIGHEST for action port [ 922.062123] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4664b2d0-713d-4ef5-b8b6-70b094cf9903 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.062823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4664b2d0-713d-4ef5-b8b6-70b094cf9903" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.063037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4664b2d0-713d-4ef5-b8b6-70b094cf9903" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.063392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4664b2d0-713d-4ef5-b8b6-70b094cf9903" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.063559] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4664b2d0-713d-4ef5-b8b6-70b094cf9903',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.088204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.088396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.088583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.088686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.088852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.089084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4335ae2-ca25-40a1-97b1-512d03a99b27" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.560178] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.566487] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4664b2d0-713d-4ef5-b8b6-70b094cf9903 [ 922.566914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.567143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.567265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.567526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.567676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.568224] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4664b2d0-713d-4ef5-b8b6-70b094cf9903 already deleted. [ 922.568383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4664b2d0-713d-4ef5-b8b6-70b094cf9903" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.067569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.067744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.067855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.068139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.068305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.070950] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c is going to be created. [ 923.100010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.100187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.100255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.100478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.100644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.112878] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: UNINITIALIZED for 2s [ 923.549996] env[69350]: INFO networking_nsxv3.common.synchronization [None req-925168bb-00c6-4406-9738-1b0ffb2e15ee tempest-ServersTestManualDisk-690118913 tempest-ServersTestManualDisk-690118913-project-member] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 923.549996] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 923.549996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.549996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.549996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.549996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.549996] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.725673] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0ffdbc81-8e1c-4478-9f75-f30ec86bf36a tempest-ServersTestManualDisk-690118913 tempest-ServersTestManualDisk-690118913-project-member] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 923.725673] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 923.727060] env[69350]: INFO networking_nsxv3.common.synchronization [req-2238ead7-d832-42f0-a027-5b84b1e80a91 req-080bbe18-2c2e-485b-a475-1634e56b8d9b tempest-ServersV294TestFqdnHostnames-993868252 tempest-ServersV294TestFqdnHostnames-993868252-project-member] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 923.727139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.727210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.729187] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGHEST for action security_group_members [ 923.729187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.729187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.729187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.729673] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.082477] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.082477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.082688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.083142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.083142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.083142] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef already deleted. [ 924.083142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.083316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.083506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.083621] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.233677] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.234084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.234295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.235097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.235217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.235438] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.235569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.235636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.235817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.235904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.235997] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b is going to be updated. [ 924.286255] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.286255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.286255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.286255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.286486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.301158] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: IN_PROGRESS for 2s [ 924.635481] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.635644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.638209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.639027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.639027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.639027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef already deleted. [ 924.639027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.842319] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d2bfd38e-8dc3-42a2-ad44-2a6b282a94f2 None None] Enqueued Resource ID: 573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8 with Priority: HIGHEST for action port [ 924.843019] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8 with Priority: HIGHEST for action port [ 924.843592] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.843764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.843842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.844175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.844320] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.127235] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: UNINITIALIZED for 4s [ 925.347485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8 [ 925.347768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.347947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.347984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.348224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.348317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.348413] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8 already deleted. [ 925.348494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573fe7bd-d05d-44dc-a6a7-4cc7b83c68b8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.745401] env[69350]: INFO networking_nsxv3.common.synchronization [req-8556bc43-8d72-4cf9-95d7-e5bfc9143e00 req-0fc7cc08-734e-4c43-87a3-4e699237bd24 tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 925.747026] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 925.747393] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.747525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.747593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.747803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.748167] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.748513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.748627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.748751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.130583] env[69350]: INFO networking_nsxv3.common.synchronization [req-d98e41a1-95a1-4a57-89be-e363aca0c9e7 req-08b34af1-9661-4816-bc3e-4530ac09b501 tempest-ServerMetadataNegativeTestJSON-1700653367 tempest-ServerMetadataNegativeTestJSON-1700653367-project-member] Enqueued Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 926.131219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGHEST for action security_group_members [ 926.131574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.131652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.131713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.131952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.132120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.132363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.132433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.132594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.132681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.132774] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.251153] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.301029] env[69350]: INFO networking_nsxv3.common.synchronization [req-1685aec1-b5e5-4408-8827-edfc6dbc3dcf req-f8344c4d-cd09-4fd5-b6d4-636b172179dc tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 926.301598] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 926.302854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.302987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.303067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.303353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.303546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.303670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.303735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.303919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.304024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.304140] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.313430] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b in Status: SUCCESS [ 926.313620] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b deletion is rescheduled due to dependency. [ 926.313742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.639019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.639019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.639019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.639019] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f is going to be updated. [ 926.669081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.669241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.670721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.670721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.670721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.676652] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.676652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.676652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.676652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.676879] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.677122] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.677122] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.677666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.677666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.677666] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.677777] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.678212] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.678212] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.678212] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.678212] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.678410] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.680151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: IN_PROGRESS for 2s [ 926.703147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.704786] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.704786] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.704786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.704786] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6c34779c-a7ad-4467-8229-d683dda76778 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.704786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.704786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.704786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.704786] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c34779c-a7ad-4467-8229-d683dda76778',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.754839] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.810054] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.810054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.810054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.810411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.810411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.810589] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.810690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.810770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.810966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.811139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.811246] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d already deleted. [ 926.811334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.142198] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: SUCCESS [ 927.142566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.142723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.143009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.143262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.143419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.143579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.143774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.143967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.144023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.144119] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.208166] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.208563] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.208704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.209106] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.209560] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.209810] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6c34779c-a7ad-4467-8229-d683dda76778 not found, creating... [ 927.210144] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.210369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.210522] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.210801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.211492] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.211892] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.212142] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.212315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.212608] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.212804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.212964] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6c34779c-a7ad-4467-8229-d683dda76778 is going to be created. [ 927.257747] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.258015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.258155] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.258449] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.258690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.258950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.259867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.260047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.260135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.260317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.260390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.260484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 927.307899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.308091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.308188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.308426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.308586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.329619] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 927.646548] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.646548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.646548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.646795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.646933] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647568] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647990] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.648101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.648181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.648367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.648470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648680] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.150786] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ff45cfa-44be-4184-a622-fcee3f7d548c: rpc.has_security_group_logging(os_id): False [ 928.180612] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.180612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.180612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.180612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.180612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.180926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.180926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.180926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.181214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.181321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.181602] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.181900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.181999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.182212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.182315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.182570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.182722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.182807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.183580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.183580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.183580] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c is going to be created. [ 928.274927] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.275148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.275241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.275562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.275854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.296409] env[69350]: INFO networking_nsxv3.common.synchronization [req-1685aec1-b5e5-4408-8827-edfc6dbc3dcf req-a952d135-9ff8-4190-bdb7-a3d53d1f2939 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 928.296735] env[69350]: INFO networking_nsxv3.common.synchronization [req-1685aec1-b5e5-4408-8827-edfc6dbc3dcf req-a952d135-9ff8-4190-bdb7-a3d53d1f2939 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 928.298152] env[69350]: INFO networking_nsxv3.common.synchronization [req-1685aec1-b5e5-4408-8827-edfc6dbc3dcf req-a952d135-9ff8-4190-bdb7-a3d53d1f2939 service nova] Enqueued Resource ID: 6c34779c-a7ad-4467-8229-d683dda76778 with Priority: HIGHEST for action port [ 928.298152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: IN_PROGRESS for 2s [ 928.298982] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 928.298982] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 928.298982] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c34779c-a7ad-4467-8229-d683dda76778 with Priority: HIGHEST for action port [ 928.299194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.299288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.299337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.299608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.299688] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.301083] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.301250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.301328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.301471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.302294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.302294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.302294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.302294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.302294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.302294] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.303120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c34779c-a7ad-4467-8229-d683dda76778 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.303120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.303120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.306354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.306354] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c34779c-a7ad-4467-8229-d683dda76778',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.691127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f in Status: SUCCESS [ 928.691432] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f deletion is rescheduled due to dependency. [ 928.691604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.807690] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.807690] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.807690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.807690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c34779c-a7ad-4467-8229-d683dda76778 with status ACTIVE [ 928.807690] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.807690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.807690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.807690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.808085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.808085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.808415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.808415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.808735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.808735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.808891] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.809051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.809155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.809344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.809479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.809589] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c34779c-a7ad-4467-8229-d683dda76778 is going to be updated. [ 928.833718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.833857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.833938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.834241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.834427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.834638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c34779c-a7ad-4467-8229-d683dda76778" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.307949] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.349116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 929.349527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.811143] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.811313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.811343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.811549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.811639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.811738] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be created. [ 929.836970] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.837229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.837229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.837445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.837612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.848733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: UNINITIALIZED for 2s [ 930.311476] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: SUCCESS [ 930.311792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.862991] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 931.862991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.862991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.862991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.862991] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.862991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.864873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.864873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.864873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.864873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.864873] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.371023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.371023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.371023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.371023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.371023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.371484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.371484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.371484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.371567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.371613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.371955] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.371955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.371955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.372268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.372268] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.372268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.374595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.374595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.374595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.374595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.374595] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.874801] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f77ff482-c36b-41a0-9c84-caa4cc51cf3d: rpc.has_security_group_logging(os_id): False [ 932.896297] env[69350]: INFO networking_nsxv3.common.synchronization [req-33cdebee-5d32-4b36-83e7-4125bf5e1266 req-ad40078e-2243-4d25-af2e-317b35ee1454 tempest-ServersWithSpecificFlavorTestJSON-1882177607 tempest-ServersWithSpecificFlavorTestJSON-1882177607-project-member] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 932.897400] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.897553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.897665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.899915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.900112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.900424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.900608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.900720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.901122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.901292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.901551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.901735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.901853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.902193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.902294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.902584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.902716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.902789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.903161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.903275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.903408] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be created. [ 932.906625] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGHEST for action security_group_members [ 932.907597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.907725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.907796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.907981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.908182] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.908312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.908398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.908613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.908731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.909037] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.983227] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.983394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.983470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.983688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.983873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.003221] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 933.413073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.413073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.413073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.413073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.413292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.413323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.413415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.413708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.413708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.413708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.413825] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be updated. [ 933.451037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.451259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.451322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.452095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.452095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.462443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: IN_PROGRESS for 2s [ 933.974126] env[69350]: INFO networking_nsxv3.common.synchronization [req-253d8983-b0df-4764-b58b-a3062c6de0a4 req-6903a805-df33-41db-83d9-f385f59c5f52 tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 933.974745] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGHEST for action security_group_members [ 933.975892] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.976078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.976169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.979106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.979106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.979106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.979106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.979106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.979106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.979106] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.362320] env[69350]: INFO networking_nsxv3.common.synchronization [req-91febfab-2666-4d35-a4ff-25e7582ca97a req-fac5a862-3ff6-44e6-ab9d-f9a365236558 tempest-ListImageFiltersTestJSON-65517452 tempest-ListImageFiltersTestJSON-65517452-project-member] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 934.362850] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 934.363170] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.363294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.363405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.363585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.363761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.363838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.363892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.364059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.364140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.364228] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.481333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.481333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.481452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.483216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.483336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.483580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.483694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.484148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.484365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.484451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.484549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c is going to be updated. [ 934.543409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.543409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.543409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.543409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.543409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.562592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: IN_PROGRESS for 2s [ 934.866838] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.868502] env[69350]: INFO networking_nsxv3.common.synchronization [req-27a3585f-c3de-4541-bca9-eef751662db9 req-14dbf34b-826a-403c-815f-ec1a417a96ff tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 934.869277] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 934.869619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.869788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.869887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.870217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.870605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.870605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.870742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.870931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.871029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.871173] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.017278] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 935.017590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.370245] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.374269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.374483] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.374560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.374862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.375024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.375289] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.375390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.375476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.375680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.375793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.375920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 already deleted. [ 935.376034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.435704] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.435946] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.436090] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.436388] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.437308] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.437567] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.437644] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.437881] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.438651] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.439287] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.440031] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.440031] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.440031] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.440031] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.440031] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.440275] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.461662] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.461901] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.462067] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.462300] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.462583] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-d80c593e-2843-44d6-ae4b-1088b5635fc7 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.462746] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.462874] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.463232] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.463378] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80c593e-2843-44d6-ae4b-1088b5635fc7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.472781] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518254d1-d440-4d15-b32d-8975c834377a in Status: SUCCESS [ 935.472977] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518254d1-d440-4d15-b32d-8975c834377a deletion is rescheduled due to dependency. [ 935.473116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.875294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.875474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.875592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.875828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.875917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.876025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be updated. [ 935.911844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.913239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.913239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.913239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.913239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.926302] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 935.966328] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.966626] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.966787] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.967154] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.967318] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.967477] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port d80c593e-2843-44d6-ae4b-1088b5635fc7 not found, creating... [ 935.967798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.967981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.968123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.968434] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.968524] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.968798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.969018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.969087] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.969338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.969521] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.969629] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: d80c593e-2843-44d6-ae4b-1088b5635fc7 is going to be created. [ 935.998653] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.998993] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.999353] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.999508] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.999735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.999972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.574696] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c in Status: SUCCESS [ 936.574968] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c deletion is rescheduled due to dependency. [ 936.574968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.800051] env[69350]: INFO networking_nsxv3.common.synchronization [req-27a3585f-c3de-4541-bca9-eef751662db9 req-c36d8a9b-a5ed-4bc2-b7ae-d0de13909229 service nova] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_rules [ 936.800262] env[69350]: INFO networking_nsxv3.common.synchronization [req-27a3585f-c3de-4541-bca9-eef751662db9 req-c36d8a9b-a5ed-4bc2-b7ae-d0de13909229 service nova] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 936.800408] env[69350]: INFO networking_nsxv3.common.synchronization [req-27a3585f-c3de-4541-bca9-eef751662db9 req-c36d8a9b-a5ed-4bc2-b7ae-d0de13909229 service nova] Enqueued Resource ID: d80c593e-2843-44d6-ae4b-1088b5635fc7 with Priority: HIGHEST for action port [ 936.800932] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_rules [ 936.801092] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 936.801263] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d80c593e-2843-44d6-ae4b-1088b5635fc7 with Priority: HIGHEST for action port [ 936.801548] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.801666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.801732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.801989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.802087] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.802934] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.803058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.803129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.803302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.803446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.803567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.803631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.803775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.803861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.803951] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.804709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d80c593e-2843-44d6-ae4b-1088b5635fc7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.804817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.804883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.805118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.805118] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80c593e-2843-44d6-ae4b-1088b5635fc7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.306739] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.307147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.307147] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.308042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d80c593e-2843-44d6-ae4b-1088b5635fc7 with status ACTIVE [ 937.311626] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.311626] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.311626] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.311626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.311626] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d80c593e-2843-44d6-ae4b-1088b5635fc7 is going to be updated. [ 937.337264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.337437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.337478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.337783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.337974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.338189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d80c593e-2843-44d6-ae4b-1088b5635fc7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.574599] env[69350]: INFO networking_nsxv3.common.synchronization [req-ee156a34-533d-4734-ad4b-4352e876d8cc req-9dca4e17-949a-45a3-8b94-73a8bf0f5695 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 937.575127] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 937.575478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.575648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.575734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.575958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.576170] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.576257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.576298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.576429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.576514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.576610] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.816820] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.937192] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 937.939062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.079676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.082794] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.082794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.082794] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 938.120028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.120028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.120028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.120028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.120028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.131529] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.131744] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.131822] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.132503] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.132503] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.132503] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.132679] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.132814] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.132960] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.133178] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.133296] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.133403] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.133551] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.133851] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.133851] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.133943] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.135627] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 938.157067] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.157067] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.157209] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.158023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.158023] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.158023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.158232] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.158510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.158655] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.328139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.328139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.328139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.328139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.328139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.328139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be created. [ 938.361053] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.361053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.361053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.361053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.361053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.372701] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: UNINITIALIZED for 2s [ 938.663213] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.663213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.663213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.663213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.663213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.663213] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 not found, creating... [ 938.663213] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.663830] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.663830] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.663888] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.665279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.665279] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.665279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.665279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.665790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.665790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.665790] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 is going to be created. [ 938.719950] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.720217] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.720347] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.720653] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.720892] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.721208] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.820484] env[69350]: INFO networking_nsxv3.common.synchronization [req-1060a705-297f-4d70-99ff-989799855fbc req-75048e52-d8be-45af-9417-d24a384f4dbb tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 938.820484] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGHEST for action security_group_members [ 938.820757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.820912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.820995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.821262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.821726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.821726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.821726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.821896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.821896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.821949] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.327731] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.327731] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.327731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.327731] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be updated. [ 939.382225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.382225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.382225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.382225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.382225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.404091] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: IN_PROGRESS for 2s [ 939.616226] env[69350]: INFO networking_nsxv3.common.synchronization [req-ee156a34-533d-4734-ad4b-4352e876d8cc req-d7636495-7b53-4d30-be34-a6f1a1e95c4e service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 939.616541] env[69350]: INFO networking_nsxv3.common.synchronization [req-ee156a34-533d-4734-ad4b-4352e876d8cc req-d7636495-7b53-4d30-be34-a6f1a1e95c4e service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 939.616764] env[69350]: INFO networking_nsxv3.common.synchronization [req-ee156a34-533d-4734-ad4b-4352e876d8cc req-d7636495-7b53-4d30-be34-a6f1a1e95c4e service nova] Enqueued Resource ID: 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 with Priority: HIGHEST for action port [ 939.617506] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 939.617709] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 939.617862] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 with Priority: HIGHEST for action port [ 939.618267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.618437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.618536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.620960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.620960] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.622364] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.622464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.623371] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.623550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.623630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.623828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.625795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.129805] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.130173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.130173] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 with status ACTIVE [ 940.130327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.130436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.130514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.130771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.130870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.130954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.131078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.131138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.131332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.131413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.131600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.131691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.131754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.131895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.131968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.132066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8 is going to be updated. [ 940.147417] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 940.147581] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 940.147730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.147918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.148159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.148335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.148489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.148523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.148684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.148733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.149027] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.157694] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.157845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.157966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.158456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.158456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.158456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f9b643e-9c9f-4bcb-816d-2f55cd6b68c8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.247666] env[69350]: INFO networking_nsxv3.common.synchronization [req-58b18b19-f390-4b03-9a25-1580a49ffcaf req-1e3a550c-4500-402a-bde4-e80f2062f9d1 tempest-FloatingIPsAssociationTestJSON-45960377 tempest-FloatingIPsAssociationTestJSON-45960377-project-member] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 940.248429] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 940.248766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.252028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.252028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.252028] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.389989] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 940.390230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.390428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.390652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.390848] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.390968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.391046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.391261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.391358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.391449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.391544] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.652884] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.753863] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.893659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.894074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.894179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.894391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.894587] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.894693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.894739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.894891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.894974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.895072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.895221] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.895335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.895395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.895536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.895666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.895751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.895807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.895954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.896038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.896194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.896194] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.019271] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.019271] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.019271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.020040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.020040] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.020040] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.020040] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.020191] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.020315] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.020431] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.020567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.042966] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.043159] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.043312] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.043498] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.043817] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-217375a8-eb1f-4777-83dd-c07326f76ae0 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.043992] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.044126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.044459] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.044609] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217375a8-eb1f-4777-83dd-c07326f76ae0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.156202] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.257987] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.399154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c5d6740-3439-4769-8b56-9e97215cbf77: rpc.has_security_group_logging(os_id): False [ 941.414632] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b in Status: SUCCESS [ 941.414826] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b deletion is rescheduled due to dependency. [ 941.414916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.417214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.417344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.417415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.417629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.417715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.417926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.418037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.418944] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.418944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.419372] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.419372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.419372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.419372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.419372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.419523] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be created. [ 941.485804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.485957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.486036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.486255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.486442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.499952] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 941.548083] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.552017] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 217375a8-eb1f-4777-83dd-c07326f76ae0 not found, creating... [ 941.552017] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.552017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.552690] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.552690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.552690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.552690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.552690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.552690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 217375a8-eb1f-4777-83dd-c07326f76ae0 is going to be created. [ 941.578409] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.578638] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.578768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.579176] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.583025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.583025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.660039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.660039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.660039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.660039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.660039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.660039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 941.723977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.724186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.724186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.724389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.724544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.737320] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 941.761347] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.761532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.761617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.761886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.761943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.762043] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be updated. [ 941.815685] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.815838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.815902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.816278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.816278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.831035] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 942.465694] env[69350]: INFO networking_nsxv3.common.synchronization [req-58b18b19-f390-4b03-9a25-1580a49ffcaf req-2b23f897-1f4c-4952-ae23-9136de0c20a8 service nova] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_rules [ 942.465961] env[69350]: INFO networking_nsxv3.common.synchronization [req-58b18b19-f390-4b03-9a25-1580a49ffcaf req-2b23f897-1f4c-4952-ae23-9136de0c20a8 service nova] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 942.466547] env[69350]: INFO networking_nsxv3.common.synchronization [req-58b18b19-f390-4b03-9a25-1580a49ffcaf req-2b23f897-1f4c-4952-ae23-9136de0c20a8 service nova] Enqueued Resource ID: 217375a8-eb1f-4777-83dd-c07326f76ae0 with Priority: HIGHEST for action port [ 942.466736] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_rules [ 942.466736] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 942.466836] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217375a8-eb1f-4777-83dd-c07326f76ae0 with Priority: HIGHEST for action port [ 942.468394] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.468555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.468619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.469653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.469653] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.471697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.471697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.471697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-217375a8-eb1f-4777-83dd-c07326f76ae0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.472542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.472542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.472542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.472542] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217375a8-eb1f-4777-83dd-c07326f76ae0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.794974] env[69350]: INFO networking_nsxv3.common.synchronization [req-cebafe79-5dde-470c-90bf-38eade47299e req-91b058c1-4730-4c62-85ed-569e91bdc788 tempest-ServersNegativeTestJSON-814899616 tempest-ServersNegativeTestJSON-814899616-project-member] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 942.795901] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 942.795988] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.796103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.796165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.796469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.796538] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.796610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.796681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.797281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.797399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.797572] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.975149] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.975149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.976190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 217375a8-eb1f-4777-83dd-c07326f76ae0 with status ACTIVE [ 942.976740] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.976740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.976740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.976899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.976927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.977120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.977215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.977273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.977426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.977498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.977671] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.977761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.977818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.977956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978122] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 217375a8-eb1f-4777-83dd-c07326f76ae0 is going to be updated. [ 943.005360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.005360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.005360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.005360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.005360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.005360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-217375a8-eb1f-4777-83dd-c07326f76ae0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.300638] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.514669] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 943.515044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.541137] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-543 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.541420] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.541563] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.541860] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.543502] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.543748] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.543887] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.544198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.544373] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.544611] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.544731] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.544847] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.544960] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.545087] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.545208] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.545354] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.570221] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.570403] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.570551] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.570746] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.571089] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-835f5898-8b2f-4979-8460-f23ad3725280 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.571345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.571488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.571826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.571972] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('835f5898-8b2f-4979-8460-f23ad3725280',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.748241] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 943.748456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.748625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.748836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.749079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.749169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.751367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.751367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.751367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.751367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.751367] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.805296] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.844113] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 943.844547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.844682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.844950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.845194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.845379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.845436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.845627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.845719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.846027] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.077705] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.077945] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.078090] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.078401] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.078556] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.078738] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 835f5898-8b2f-4979-8460-f23ad3725280 not found, creating... [ 944.079038] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.079230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.079384] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.079617] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.079762] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.080206] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.080401] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.080528] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.080744] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.080881] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.081038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 835f5898-8b2f-4979-8460-f23ad3725280 is going to be created. [ 944.104365] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.104598] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.104725] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.105050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.105291] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.105533] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.254426] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.254426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.254426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.254426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.254653] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.254653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.254734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.255463] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.255463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.255851] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.255851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.255851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.255851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.255975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.255975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.256069] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.307736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.307898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.307971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.308264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.308361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.308710] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 944.342227] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.342421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.342471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.342739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.342931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.348183] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.354789] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 944.759036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 944.782487] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.782726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.782852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.783209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.783367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.783660] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.783819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.783985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.784172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.784291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.784600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.784773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.784854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.785709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.785845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.787623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.787623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.787623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.787623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.787623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.787623] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 944.855223] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.885910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.886129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.886129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.886362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.886559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.906013] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 945.040302] env[69350]: INFO networking_nsxv3.common.synchronization [req-cebafe79-5dde-470c-90bf-38eade47299e req-4ce77fed-a0f6-42cb-bfde-f41885517203 service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 945.040302] env[69350]: INFO networking_nsxv3.common.synchronization [req-cebafe79-5dde-470c-90bf-38eade47299e req-4ce77fed-a0f6-42cb-bfde-f41885517203 service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 945.040302] env[69350]: INFO networking_nsxv3.common.synchronization [req-cebafe79-5dde-470c-90bf-38eade47299e req-4ce77fed-a0f6-42cb-bfde-f41885517203 service nova] Enqueued Resource ID: 835f5898-8b2f-4979-8460-f23ad3725280 with Priority: HIGHEST for action port [ 945.040744] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 945.040883] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 945.040981] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f5898-8b2f-4979-8460-f23ad3725280 with Priority: HIGHEST for action port [ 945.041444] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.041586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.041629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.042161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.042161] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.042845] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.042945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.043186] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-835f5898-8b2f-4979-8460-f23ad3725280 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.043301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.043366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.043555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.043651] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('835f5898-8b2f-4979-8460-f23ad3725280',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.360376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.360657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.360724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.360907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.361015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.361116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be updated. [ 945.394922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.395206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.395325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.395644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.395813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.408961] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 945.547289] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.547289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.547289] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 835f5898-8b2f-4979-8460-f23ad3725280 with status ACTIVE [ 945.547533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.547533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.547533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.547779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.551024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 835f5898-8b2f-4979-8460-f23ad3725280 is going to be updated. [ 945.575157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.575157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.575157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.575157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.575157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.575157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-835f5898-8b2f-4979-8460-f23ad3725280" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367752] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 946.368607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.368671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.368973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.371062] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.371062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.371062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.371221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.371343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.371411] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.460535] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1721bdc-c94c-411e-8341-2c5ae587bacb req-9b1602bf-ae24-480b-a116-42a8c578c871 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 946.461108] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 946.461514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.461651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.461721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.461990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.462163] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.462279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.462347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.462508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.462594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.462689] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.873846] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.922047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 946.922296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.970206] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.970414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.970414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.970647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.970735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.970930] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.971047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.971105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.971293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.971381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.971445] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 already deleted. [ 946.971528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.378111] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.420727] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 947.421061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.421238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.421563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.421766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.423488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.423630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.423868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.423960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.424075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.424296] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.801512] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.801742] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.801870] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.802240] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.802520] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.802686] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.802804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.803191] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.803312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.803519] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.803741] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.803878] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.804052] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.804114] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.804259] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.804353] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.824660] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.824855] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.825009] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.825200] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.825518] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-8ce2b462-3506-480a-b1da-0211dced1bf3 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.825689] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.825813] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.826164] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.826308] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce2b462-3506-480a-b1da-0211dced1bf3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.880318] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.880318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.880318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.880580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.880580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.880640] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 947.911576] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.911576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.911797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.911956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.911996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.921751] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 947.929243] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.929243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.929243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.930686] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.930686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.931251] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.931251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.931251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.931251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.931490] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.932030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.932030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.932030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.932030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.932313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.932313] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.329087] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.329409] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.329555] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.329875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.330117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.330242] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 8ce2b462-3506-480a-b1da-0211dced1bf3 not found, creating... [ 948.330511] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.330678] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.330800] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.331065] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.331252] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.331570] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.331784] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.331847] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.332644] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.332752] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.332905] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 8ce2b462-3506-480a-b1da-0211dced1bf3 is going to be created. [ 948.356880] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.357142] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.357277] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.357599] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.357931] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.358199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.437435] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e075408-82f5-4e52-84f7-426a04568f7e: rpc.has_security_group_logging(os_id): False [ 948.465202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.465202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.465202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.465546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.465546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.465661] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.465731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.469025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.469025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.469025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.469025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be updated. [ 948.575184] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.575373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.575434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.575598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.575745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.599035] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1721bdc-c94c-411e-8341-2c5ae587bacb req-c674d687-ded6-4e89-a989-b062c528ecba service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1721bdc-c94c-411e-8341-2c5ae587bacb req-c674d687-ded6-4e89-a989-b062c528ecba service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [req-d1721bdc-c94c-411e-8341-2c5ae587bacb req-c674d687-ded6-4e89-a989-b062c528ecba service nova] Enqueued Resource ID: 8ce2b462-3506-480a-b1da-0211dced1bf3 with Priority: HIGHEST for action port [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 949.239027] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ce2b462-3506-480a-b1da-0211dced1bf3 with Priority: HIGHEST for action port [ 949.239027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.239027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.239027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.239848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.239848] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.241713] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.241713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.241899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.242138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.242306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.242408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.242487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.242622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.242707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.242800] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.244177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ce2b462-3506-480a-b1da-0211dced1bf3 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.244177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.244331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.244390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.249032] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce2b462-3506-480a-b1da-0211dced1bf3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.734234] env[69350]: INFO networking_nsxv3.common.synchronization [req-554d96f0-83be-436f-9544-04e1ce69c2db req-2492d8da-e7fe-45c8-ad45-bd0b53ed6ef0 tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 949.737882] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 949.737882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.737882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.737882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.737882] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.754484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.754484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.754484] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.754484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ce2b462-3506-480a-b1da-0211dced1bf3 with status ACTIVE [ 949.754484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.754484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.754484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.756201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.756360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.756537] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.756620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.756682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.756858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.756940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.757194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.757295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.757354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.757505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.757578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.757671] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ce2b462-3506-480a-b1da-0211dced1bf3 is going to be updated. [ 949.780951] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.781040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.781093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.781382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.781541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.781713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ce2b462-3506-480a-b1da-0211dced1bf3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.940514] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 949.940514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.943563] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.943563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.943563] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.211860] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.212082] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.212241] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.212720] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.213035] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.213251] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.213384] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.213695] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.213894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.214161] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.214279] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.214425] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.214547] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.214661] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.214969] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.214969] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.237864] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.238068] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.238216] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.238403] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-632" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.238729] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.238900] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.239038] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.239515] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.239580] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.240569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.240684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.240752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.240929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.241031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.241201] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.241301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.241416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.241544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.241619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.241696] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 950.260427] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.273554] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.276631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.276747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.278049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.278049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.290916] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 950.448744] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.448912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.448973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.449239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.449603] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.449721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.449786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.449949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.450056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.450147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.450327] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.450403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.450443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.450580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.450715] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.450803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.450884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.450992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.451077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.451158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.451246] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.614839] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 950.615107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.743719] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.744063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.744153] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.744454] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.744615] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.744785] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a not found, creating... [ 950.745084] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.745268] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.745409] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.745667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.745804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.746207] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.746399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.746807] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.746807] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.746953] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.747127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a is going to be created. [ 950.766600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.766965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.766965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.767135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.767244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.767365] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be created. [ 950.772239] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.772531] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.772597] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.773199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.773457] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.773710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.795264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.795469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.795566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.795787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.796025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.812450] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: UNINITIALIZED for 2s [ 950.956793] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac836d8b-740c-4a34-ae58-041041eb8e77: rpc.has_security_group_logging(os_id): False [ 950.982139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.982376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.982376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.982621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.982716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.982992] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.983121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.983121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.983301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.983383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.983595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.983711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.983772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.983918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.983992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.984199] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.984295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.984404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.984503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.984585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.984678] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 951.075738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.075934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.075974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.076176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.076330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.095031] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 951.808961] env[69350]: INFO networking_nsxv3.common.synchronization [req-554d96f0-83be-436f-9544-04e1ce69c2db req-67981744-89d6-4af9-a5d6-8bff835d3ea6 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 951.809491] env[69350]: INFO networking_nsxv3.common.synchronization [req-554d96f0-83be-436f-9544-04e1ce69c2db req-67981744-89d6-4af9-a5d6-8bff835d3ea6 service nova] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 951.809666] env[69350]: INFO networking_nsxv3.common.synchronization [req-554d96f0-83be-436f-9544-04e1ce69c2db req-67981744-89d6-4af9-a5d6-8bff835d3ea6 service nova] Enqueued Resource ID: e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a with Priority: HIGHEST for action port [ 951.809910] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_rules [ 951.810095] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 951.810146] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a with Priority: HIGHEST for action port [ 951.810874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.810874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.810874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.812093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.812200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.813440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.814392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.814439] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.306014] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 952.306285] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 deletion is rescheduled due to dependency. [ 952.306664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.306739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.306997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.307841] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.307841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.307841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.307841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.308069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.308621] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.321881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.321881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.321881] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a with status ACTIVE [ 952.321881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.321881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.321881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.322156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.322156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.322371] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.322554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.322639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.322823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.322940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.328032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.328032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.328032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.328032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.328032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.328032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a is going to be updated. [ 952.354844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.355058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.355477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.355477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.355477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.355692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1d007fd-edb4-4ae6-8cbd-b7aab6dc0f6a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.812072] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.823168] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 952.823616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.825018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.825018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.825018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.825018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.825018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.825018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.826719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.826719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.826719] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.112478] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 953.115962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313694] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.328379] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.328587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.328659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.329303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.329303] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.329303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.329303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.329534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.329714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.329714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.329825] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.329917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.329917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.330155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.330229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.330288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.330378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.330718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.330718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.330718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.330718] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.816370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.816766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.816766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.816853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.816971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.817146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 953.837244] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 953.855485] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.855681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.855797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.856009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.856394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.868365] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.868460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.868589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.868785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.868846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.869150] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.869317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.869317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.869613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.869692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.869884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.870016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.870050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.870195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.870268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.870457] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.870571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.870646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.870795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.870882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.871115] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be created. [ 953.873522] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 953.950558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.952174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.952174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.952174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.952174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.968507] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 954.850271] env[69350]: INFO networking_nsxv3.common.synchronization [req-c663fd94-86c2-4064-ba04-4b9c0dc33d4c req-8c86ba1f-5bed-4ff2-ae51-8662ffd95b63 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 954.850271] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 954.850271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.850271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.850271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.850271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.850271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.851527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.851527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.851527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.851768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.851768] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.353521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.353792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.353871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.354164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.354280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.354512] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.354648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.354717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.354926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.355032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.355138] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 955.393882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.394087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.394135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.394342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.394496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.406968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 955.788852] env[69350]: INFO networking_nsxv3.common.synchronization [req-0948e058-2f43-415b-bd5d-231cb8364b30 req-8515bdd9-db18-4fc1-a1aa-30e698d16baa tempest-ServersTestManualDisk-690118913 tempest-ServersTestManualDisk-690118913-project-member] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 955.789625] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 955.789974] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.790135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.790202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.790529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.790672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.790787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.790843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.791029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.791137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.791200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.890038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 955.890503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.890763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.891331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.891666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.891885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.892011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.892763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.892970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.893471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.893646] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.984190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 955.984855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.293249] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.293486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.293486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.293765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.293861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.294139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.294310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.294532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.294666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.294765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.294898] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef already deleted. [ 956.294995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.401908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.402115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.402195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.402367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.402536] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.402629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.402695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.402842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.403871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.403939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.404061] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.404160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.404224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.404378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.404523] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.404633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.404690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.404831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.404928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.404986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.408654] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.426801] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.427012] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.427193] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.427484] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.428673] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.428856] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.429083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.429439] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.429866] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.430203] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.430446] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.430594] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.430802] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.431140] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.431403] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.431812] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.455404] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.455938] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 956.456136] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.456322] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.456992] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.457198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.457326] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.457868] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.458316] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a50b5bbe-4267-47bf-a2c7-a1cd042d51d5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.912107] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3373549f-c839-4d1c-a55a-af37a3148994: rpc.has_security_group_logging(os_id): False [ 956.933592] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.933592] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.933592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.934031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.934031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.934197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.934379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.934459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.934644] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.934755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.934828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.934974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.935061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.935146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 956.962205] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.962562] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.962682] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.963013] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.963178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.963311] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 not found, creating... [ 956.963563] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.963740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.963935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.964186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.964341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.964613] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.964765] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.964881] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.965098] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.965231] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.965368] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 is going to be created. [ 956.986909] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.986909] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.986909] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.986909] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.987080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.987266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.010934] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.011111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.011156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.011785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.011785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.027022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 957.423843] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 957.424194] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 957.424194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.869337] env[69350]: INFO networking_nsxv3.common.synchronization [req-0948e058-2f43-415b-bd5d-231cb8364b30 req-b3f8e439-6d35-45e9-a59e-43f88295c5fe service nova] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 957.869476] env[69350]: INFO networking_nsxv3.common.synchronization [req-0948e058-2f43-415b-bd5d-231cb8364b30 req-b3f8e439-6d35-45e9-a59e-43f88295c5fe service nova] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 957.869659] env[69350]: INFO networking_nsxv3.common.synchronization [req-0948e058-2f43-415b-bd5d-231cb8364b30 req-b3f8e439-6d35-45e9-a59e-43f88295c5fe service nova] Enqueued Resource ID: a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 with Priority: HIGHEST for action port [ 957.870219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_rules [ 957.870219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 957.870219] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 with Priority: HIGHEST for action port [ 957.870759] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.870759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.870890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.874031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.874031] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.874031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.874031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.876794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.877028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.877906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.877906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.877906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.877906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.877906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.877906] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.882018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.882018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.882018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.882018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.882018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a50b5bbe-4267-47bf-a2c7-a1cd042d51d5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.338838] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6b4ce807-1974-4d27-8527-e69f2bf1c8bb None None] Enqueued Resource ID: 4b5fba2f-8e15-435a-bf95-045073abcdb9 with Priority: HIGHEST for action port [ 958.340140] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b5fba2f-8e15-435a-bf95-045073abcdb9 with Priority: HIGHEST for action port [ 958.340140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b5fba2f-8e15-435a-bf95-045073abcdb9 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.340480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b5fba2f-8e15-435a-bf95-045073abcdb9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.340677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b5fba2f-8e15-435a-bf95-045073abcdb9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.341205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b5fba2f-8e15-435a-bf95-045073abcdb9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.342551] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5fba2f-8e15-435a-bf95-045073abcdb9',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.381161] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.382869] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 with status ACTIVE [ 958.385018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.385018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.385018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.385018] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a50b5bbe-4267-47bf-a2c7-a1cd042d51d5 is going to be updated. [ 958.386947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.387217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.412190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.413770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.413770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.413770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.413770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.413770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a50b5bbe-4267-47bf-a2c7-a1cd042d51d5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.844374] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b5fba2f-8e15-435a-bf95-045073abcdb9 [ 958.846020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.846020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.846020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.846020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.846020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.846020] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b5fba2f-8e15-435a-bf95-045073abcdb9 already deleted. [ 958.846020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b5fba2f-8e15-435a-bf95-045073abcdb9" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.883506] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.044764] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 959.045023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.386624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.387342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.387342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.387342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.387342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.387342] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef is going to be created. [ 959.418930] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.419939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.420663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.420663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.420663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.434698] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: UNINITIALIZED for 2s [ 960.209465] env[69350]: INFO networking_nsxv3.common.synchronization [req-2b348faa-a2d6-4c56-b49a-f78ab38bda30 req-bd5fc57d-eb6f-44f7-9f7b-745b63f21307 tempest-ServersNegativeTestJSON-814899616 tempest-ServersNegativeTestJSON-814899616-project-member] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 960.210778] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 960.211233] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.211823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.211823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.211823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.212047] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.212196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.212311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.212544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.212663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.212826] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.717422] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.784182] env[69350]: INFO networking_nsxv3.common.synchronization [req-683a7b05-f698-4cf5-9071-734d7b328526 req-ac14c746-abfe-4b65-8717-86d3bbcb53c6 tempest-ServersAdminTestJSON-162619687 tempest-ServersAdminTestJSON-162619687-project-member] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 960.784873] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGHEST for action security_group_members [ 960.785481] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.788018] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.788018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.788018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.220021] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.290494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.290716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.290810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.291082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.291177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.291401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.291558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.291622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.291790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.291876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.291956] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be updated. [ 961.320896] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.321068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.321168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.321342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.321574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.330283] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: IN_PROGRESS for 2s [ 961.361152] env[69350]: INFO networking_nsxv3.common.synchronization [None req-8d32bf99-9ae7-4b87-af03-76a114ba96d8 None None] Enqueued Resource ID: 53282bc5-eb01-41f8-b584-a7b74a0f5206 with Priority: HIGHEST for action port [ 961.361590] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53282bc5-eb01-41f8-b584-a7b74a0f5206 with Priority: HIGHEST for action port [ 961.362142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-53282bc5-eb01-41f8-b584-a7b74a0f5206 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.362269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53282bc5-eb01-41f8-b584-a7b74a0f5206" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.362334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53282bc5-eb01-41f8-b584-a7b74a0f5206" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.362601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53282bc5-eb01-41f8-b584-a7b74a0f5206" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.362681] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53282bc5-eb01-41f8-b584-a7b74a0f5206',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.447563] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: SUCCESS [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.447563] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.447563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.447563] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.725395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.725719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.725719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.725856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.725968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.726089] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 961.757260] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.757423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.757466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.757788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.757951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.768632] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 961.865147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53282bc5-eb01-41f8-b584-a7b74a0f5206 [ 961.865315] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.865435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.865488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.866990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.866990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.866990] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53282bc5-eb01-41f8-b584-a7b74a0f5206 already deleted. [ 961.866990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53282bc5-eb01-41f8-b584-a7b74a0f5206" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.951563] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.454141] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a9fd008-a5ab-421a-b65b-4aa0354d7aef: rpc.has_security_group_logging(os_id): False [ 962.475067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.475415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.475596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.475889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.476063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.476382] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.476564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.476651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.476877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.477028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.477123] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef is going to be created. [ 962.542027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.542027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.542027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.542027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.542027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.554227] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: IN_PROGRESS for 2s [ 963.341643] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 in Status: SUCCESS [ 963.341643] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 deletion is rescheduled due to dependency. [ 963.341643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.794392] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 963.794392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.097785] env[69350]: INFO networking_nsxv3.common.synchronization [req-f601d778-1a3d-437a-a6fe-a189feacab8b req-3e9a2218-3ab0-400b-8ed0-719fe1b8acef tempest-FloatingIPsAssociationTestJSON-45960377 tempest-FloatingIPsAssociationTestJSON-45960377-project-member] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 964.099010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 964.099010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.099010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.099010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.099172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.099268] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.100298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.100298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.100298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.100298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.100298] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.209331] env[69350]: INFO networking_nsxv3.common.synchronization [req-6f5858c6-c6e8-4b69-8e4a-b0e3c878b221 req-cda289d4-55a5-4190-9c0f-7ff94848b622 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 964.210363] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 964.211130] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.211264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.211316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.211624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.211800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.211960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.212324] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.212497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.212725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.212789] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.568631] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: SUCCESS [ 964.568959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.571345] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.571610] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.571768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.572056] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.572368] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.572524] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.573050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.573050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.573050] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.573274] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.573380] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.573499] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.573614] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.573726] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.573838] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.573999] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.602102] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.610057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.610891] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.610891] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.610891] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.611170] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-54c51f10-4213-4ad0-a68a-177b79124c9d taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.611333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.611620] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.611992] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.612463] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54c51f10-4213-4ad0-a68a-177b79124c9d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.714737] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.715479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.715479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.715479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.750906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.751269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.751382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.751382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.751701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.751801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.751880] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 964.778613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.778887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.778887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.779195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.779195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.795165] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 965.104765] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.114806] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.115102] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.115253] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.115619] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.115799] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.115959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 54c51f10-4213-4ad0-a68a-177b79124c9d not found, creating... [ 965.116253] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.116423] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.116561] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.116782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.116923] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.117225] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.117385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.117509] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.117722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.117859] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.118019] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 54c51f10-4213-4ad0-a68a-177b79124c9d is going to be created. [ 965.145946] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.146151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.146312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.146633] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.146900] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.147190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.607930] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.608332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.608332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.608411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.608590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.608713] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be updated. [ 965.647533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.647533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.647533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.647533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.647533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.658630] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 965.831255] env[69350]: INFO networking_nsxv3.common.synchronization [req-6f5858c6-c6e8-4b69-8e4a-b0e3c878b221 req-72ac07eb-43aa-4cd7-b062-8aaa425b05fc service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 965.831638] env[69350]: INFO networking_nsxv3.common.synchronization [req-6f5858c6-c6e8-4b69-8e4a-b0e3c878b221 req-72ac07eb-43aa-4cd7-b062-8aaa425b05fc service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 965.831839] env[69350]: INFO networking_nsxv3.common.synchronization [req-6f5858c6-c6e8-4b69-8e4a-b0e3c878b221 req-72ac07eb-43aa-4cd7-b062-8aaa425b05fc service nova] Enqueued Resource ID: 54c51f10-4213-4ad0-a68a-177b79124c9d with Priority: HIGHEST for action port [ 965.833810] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 965.833987] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 965.834122] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54c51f10-4213-4ad0-a68a-177b79124c9d with Priority: HIGHEST for action port [ 965.834502] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.834577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.834610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.834801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.834886] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.835784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.835886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.837509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-54c51f10-4213-4ad0-a68a-177b79124c9d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.837509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.837509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.837509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.837509] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54c51f10-4213-4ad0-a68a-177b79124c9d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.340349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340349] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54c51f10-4213-4ad0-a68a-177b79124c9d with status ACTIVE [ 966.340349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.340349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.340349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.340349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.341281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.341281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.341281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.341281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.341281] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54c51f10-4213-4ad0-a68a-177b79124c9d is going to be updated. [ 966.364452] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.364601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.364671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.364903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.365065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.365223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54c51f10-4213-4ad0-a68a-177b79124c9d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.490457] env[69350]: INFO networking_nsxv3.common.synchronization [req-a10d2e43-3b6b-4a19-bc55-e1493858a3f9 req-ef0cb681-9b9c-4271-855b-343cf9fece1f tempest-ImagesOneServerNegativeTestJSON-386225422 tempest-ImagesOneServerNegativeTestJSON-386225422-project-member] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 966.492308] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGHEST for action security_group_members [ 966.492308] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.492308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.492308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.492590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.492843] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.492896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.492946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.493828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.493918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.494751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.806478] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 966.806749] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d deletion is rescheduled due to dependency. [ 966.806852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.807066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.807288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.807472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.807591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.807682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.807829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.807903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.807999] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.997642] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.998351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.998351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.998351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.998603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.998636] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.998749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.998887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.999174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.999244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.999299] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be updated. [ 967.035438] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.035653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.035768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.036148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.036267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.052174] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: IN_PROGRESS for 2s [ 967.311184] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.668962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 967.669262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.814512] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.299638] env[69350]: INFO networking_nsxv3.common.synchronization [req-92e5840d-1626-449c-a3f1-8213eb7b27df req-3406063c-5220-4044-aa22-f7e20df00372 tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 968.300777] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 968.301318] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.301648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.301772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.302092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.302364] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.302545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.302615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.302836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.302937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.303072] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.321591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.321591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.321591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.321819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.321819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.321931] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 968.375394] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.375559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.375618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.375877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.376049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.386335] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 968.807478] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.062595] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3373549f-c839-4d1c-a55a-af37a3148994 in Status: SUCCESS [ 969.062864] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 deletion is rescheduled due to dependency. [ 969.062957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.312453] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.819610] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.820021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.820021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.820133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.820210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.820312] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 969.850122] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.850270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.850337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.850557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.850886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.860260] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 970.074696] env[69350]: INFO networking_nsxv3.common.synchronization [req-875db0db-f477-4bbe-96ab-39d5c1f8a3f9 req-14f84843-424e-4d1d-9999-b0df57301be4 tempest-ListImageFiltersTestJSON-65517452 tempest-ListImageFiltersTestJSON-65517452-project-member] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 970.075522] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGHEST for action security_group_members [ 970.075616] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.076189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.076189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.076189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.076189] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.076403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.076403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.076541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.076643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.076739] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.354112] env[69350]: INFO networking_nsxv3.common.synchronization [req-20160ba8-3334-41ae-aef3-5b986c8603d3 req-3ce417bd-ee7f-4f39-be8d-9eb01ff163a5 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 970.354689] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 970.355011] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.355149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.355215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.355418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.355616] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.355689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.355742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.355856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.355943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.356307] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.402687] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 970.403027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.403127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.403356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.403638] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.403795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.403867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.404132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.404230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.404355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.404507] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.580546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.580700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.580772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.580988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.581097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.581286] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.581380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.581525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.581669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.581750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.581857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be updated. [ 970.612813] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.612974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.613080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.613296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.613439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.623740] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: IN_PROGRESS for 2s [ 970.729413] env[69350]: INFO networking_nsxv3.common.synchronization [None req-659079fb-90ed-40c2-83c2-ec7e12fe1e8a tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 970.729615] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 970.730151] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.730443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.730702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.731053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.731431] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.731810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.732026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.732358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.732597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.732829] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.858786] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.859074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.859202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.859500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.859607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.859952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.860055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.860383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.860626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.860837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.860938] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be updated. [ 970.892271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.893563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.893563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.893563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.893563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.903559] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 970.907157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.907325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.236195] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.522484] env[69350]: INFO networking_nsxv3.common.synchronization [req-97402560-0a06-46f0-9164-43cb6bd878be req-abb194c2-3279-4c17-b373-f77157d6f076 tempest-VolumesAdminNegativeTest-181431987 tempest-VolumesAdminNegativeTest-181431987-project-member] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 971.523294] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGHEST for action security_group_members [ 971.523604] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.524535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.524636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.524860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.525036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.525144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.525208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.525359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.525448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.525544] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.740026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.870452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 971.870664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.030183] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.030183] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.030183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.030183] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 is going to be updated. [ 972.076745] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.076745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.076745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.076745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.076745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.087181] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: IN_PROGRESS for 2s [ 972.161153] env[69350]: INFO networking_nsxv3.common.synchronization [None req-504a8f72-55f3-40b6-9215-e066d32371e0 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 972.162013] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 972.163349] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.163559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.163920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.163920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.164091] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.241126] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.241894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.241894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.241894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.241894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.241894] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 972.283465] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.283623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.283709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.283993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.284250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.297700] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 972.339859] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c74ec43f-d50e-44bc-9e20-1a78b30207b4 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 972.340650] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 972.341313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.341462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.639200] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08655f30-40a0-4bfa-8418-b72abb59f910 in Status: SUCCESS [ 972.639390] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 deletion is rescheduled due to dependency. [ 972.639497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.683962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.684160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.684196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.684402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.684484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.684580] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 already deleted. [ 972.684659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.684810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.684957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.685050] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.914455] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 972.914661] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 deletion is rescheduled due to dependency. [ 972.914781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.211676] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.211814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.212126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.212126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.212237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.212319] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 already deleted. [ 973.212409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.552352] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.552823] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.552890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.553350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.553991] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.554274] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.554529] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.554869] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.555136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.555477] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.555670] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.555901] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.556062] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.556267] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.556467] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.556705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.585994] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.586253] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.586518] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.587051] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.587431] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-a7402eab-2d8b-490a-9196-925d3647a174 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.587754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.587994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.588489] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.588731] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7402eab-2d8b-490a-9196-925d3647a174',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.094465] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.094679] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.094809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.095137] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.095446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.095446] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port a7402eab-2d8b-490a-9196-925d3647a174 not found, creating... [ 974.096129] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.096129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.096129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.102024] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.102024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.102024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: a7402eab-2d8b-490a-9196-925d3647a174 is going to be created. [ 974.103231] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: IN_PROGRESS for 4s [ 974.123983] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.125031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.125031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.125031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.125345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.125795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.316049] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 974.316361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.316629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.316834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.317049] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.317189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.317256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.317387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.317466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.317577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.318516] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.318671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.318741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.318936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.319066] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.319163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.319224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.319396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.323316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.323469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.323535] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.531956] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b609fb7-c232-473c-8fcf-fa720fb5b1c3 req-e00802c3-1fe3-4b80-965b-5ffd77f4078e tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 974.532614] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 974.533090] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.533761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.533853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.534086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.534246] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.534367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.534472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.534718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.534785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.534881] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.827848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bcf01dc-147d-49bc-839a-137d73c85e2d: rpc.has_security_group_logging(os_id): False [ 974.849199] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.849199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.849199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.849199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.849199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.849438] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.849438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.849542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.849781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.849850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.850062] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.850174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.850236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.850408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.850479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.850792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.850792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.850921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.851043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.851128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.851215] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 974.928694] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.928694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.928694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.932159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.932159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.935162] env[69350]: INFO networking_nsxv3.common.synchronization [req-d02a5a27-376b-49fa-9f70-eea2baf7043b req-5e953004-6928-4253-a808-0d91478a8368 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 974.935343] env[69350]: INFO networking_nsxv3.common.synchronization [req-d02a5a27-376b-49fa-9f70-eea2baf7043b req-5e953004-6928-4253-a808-0d91478a8368 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 974.935490] env[69350]: INFO networking_nsxv3.common.synchronization [req-d02a5a27-376b-49fa-9f70-eea2baf7043b req-5e953004-6928-4253-a808-0d91478a8368 service nova] Enqueued Resource ID: a7402eab-2d8b-490a-9196-925d3647a174 with Priority: HIGHEST for action port [ 974.935749] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 974.936025] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 974.936025] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7402eab-2d8b-490a-9196-925d3647a174 with Priority: HIGHEST for action port [ 974.936591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.936708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.937242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.937359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.938892] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.938892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.938892] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.939475] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7402eab-2d8b-490a-9196-925d3647a174 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.939475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.939475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.939475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.939726] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7402eab-2d8b-490a-9196-925d3647a174',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.945622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 975.037348] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.037527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.037587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.037839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.037887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.038134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.038357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.038357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.038456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.038456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.038543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 975.065655] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.065871] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.065997] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.066470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.066592] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.066776] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.066924] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.067201] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.067357] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.068150] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.068150] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.068150] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.068150] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.068150] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.068441] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.068441] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.082991] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.083147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.083223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.083723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.083723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.087735] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.087924] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.088081] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.088259] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.088622] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-337d8cae-27c4-4b8f-9b0f-02581eac3775 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.088875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.089069] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.089456] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.089648] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337d8cae-27c4-4b8f-9b0f-02581eac3775',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.098032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 975.443355] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.444324] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7402eab-2d8b-490a-9196-925d3647a174 with status ACTIVE [ 975.444546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.444674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.444729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.445019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.445019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.445204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.445296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.445358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.445502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.445570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.445747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.445972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.445972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.446074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.446133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.446221] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7402eab-2d8b-490a-9196-925d3647a174 is going to be updated. [ 975.467866] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.468065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.468132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.468301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.468439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.468599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7402eab-2d8b-490a-9196-925d3647a174" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.593208] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.593208] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.593208] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.593495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.594061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.594061] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 337d8cae-27c4-4b8f-9b0f-02581eac3775 not found, creating... [ 975.594234] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.594396] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.594518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.594751] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.594893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.595202] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.595369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.595487] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.595731] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.595873] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.596036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 337d8cae-27c4-4b8f-9b0f-02581eac3775 is going to be created. [ 975.616897] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.617186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.617643] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.617643] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.617826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.618068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.949426] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.113829] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 in Status: SUCCESS [ 976.113829] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 deletion is rescheduled due to dependency. [ 976.113829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.390918] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b609fb7-c232-473c-8fcf-fa720fb5b1c3 req-1d567512-63b2-46a2-b24d-743ccb3690ae service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 976.391136] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b609fb7-c232-473c-8fcf-fa720fb5b1c3 req-1d567512-63b2-46a2-b24d-743ccb3690ae service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 976.391293] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b609fb7-c232-473c-8fcf-fa720fb5b1c3 req-1d567512-63b2-46a2-b24d-743ccb3690ae service nova] Enqueued Resource ID: 337d8cae-27c4-4b8f-9b0f-02581eac3775 with Priority: HIGHEST for action port [ 976.391845] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 976.391983] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 976.394383] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 337d8cae-27c4-4b8f-9b0f-02581eac3775 with Priority: HIGHEST for action port [ 976.396276] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.396472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.396472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.396691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.396767] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.397656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.397760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.398259] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-337d8cae-27c4-4b8f-9b0f-02581eac3775 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.398366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.398431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.398610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.398923] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('337d8cae-27c4-4b8f-9b0f-02581eac3775',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.451830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.451964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.452085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.452266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.452362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.452446] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 976.480394] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.480549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.480618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.480844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.480995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.490757] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 976.901183] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.901320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.901514] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 337d8cae-27c4-4b8f-9b0f-02581eac3775 with status ACTIVE [ 976.901747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.901890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.901933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.902141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.902234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.902402] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.902497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.902560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.902727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.902810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.902987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.903093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.903153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.903295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.903392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.903458] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 337d8cae-27c4-4b8f-9b0f-02581eac3775 is going to be updated. [ 976.927257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.927453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.927501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.927696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.927838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.928008] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-337d8cae-27c4-4b8f-9b0f-02581eac3775" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.955126] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 976.955413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.955575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.955807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.955902] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.111142] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 4s [ 977.458187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.458389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.504787] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 978.505182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.505277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.505465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.505675] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.505800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.505864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.506041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.506666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.506666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.506666] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.008474] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.008685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.008685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.008927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.009119] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.009229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.009293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.009449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.009537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.009652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.009806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.009919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.009987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.010147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.010287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.010381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.010443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.010580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.010657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.010743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.010834] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.123097] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 979.123285] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 979.123410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.123589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.123935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.124237] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.124367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.124433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.124613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.124691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.124847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.512749] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bcf01dc-147d-49bc-839a-137d73c85e2d: rpc.has_security_group_logging(os_id): False [ 979.534206] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.534206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.534206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.534570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.534570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.534794] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.535071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.535191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.535440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.535565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.535878] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.536140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.536269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.536500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.536840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.537190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.537356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.537495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.537717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.537839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.537972] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 979.630452] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.641931] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.642367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.642367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.642469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.642608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669818] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 980.133881] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.635386] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.635637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.635637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.635875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.636041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.636117] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 980.666444] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.666541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.666610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.666815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.667105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.677896] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 981.396603] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 981.396603] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 981.685248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 981.685826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.698617] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.698617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.698617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.698617] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.199215] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.199215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.199215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.199663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.199946] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.200530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.202333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.202333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.202333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.203268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.203472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.203657] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.707218] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f77ff482-c36b-41a0-9c84-caa4cc51cf3d: rpc.has_security_group_logging(os_id): False [ 983.724876] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.725059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.725059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.725283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.725370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.725554] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.725648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.725789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.725968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.726055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.726240] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.726331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.726390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.726527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.726595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.726785] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.726873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.726930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.727736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.727924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.728023] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 983.792595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.800043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.800043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.800043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.800043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.823739] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 985.811133] env[69350]: INFO networking_nsxv3.common.synchronization [None req-5eef809e-6751-48fd-b5c9-b88cd5fa1e4e None None] Enqueued Resource ID: 82ac852d-dad3-47a6-8f65-dd58efc21cd1 with Priority: HIGHEST for action port [ 985.811768] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ac852d-dad3-47a6-8f65-dd58efc21cd1 with Priority: HIGHEST for action port [ 985.812384] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ac852d-dad3-47a6-8f65-dd58efc21cd1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.812384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ac852d-dad3-47a6-8f65-dd58efc21cd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.812384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ac852d-dad3-47a6-8f65-dd58efc21cd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.812534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ac852d-dad3-47a6-8f65-dd58efc21cd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.812576] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ac852d-dad3-47a6-8f65-dd58efc21cd1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.841913] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 985.841913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.314777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82ac852d-dad3-47a6-8f65-dd58efc21cd1 [ 986.315083] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.315261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.315333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.315575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.316141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.316141] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82ac852d-dad3-47a6-8f65-dd58efc21cd1 already deleted. [ 986.316141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ac852d-dad3-47a6-8f65-dd58efc21cd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.521588] env[69350]: INFO networking_nsxv3.common.synchronization [req-d434ad74-7f1e-4c28-9014-0d3f3d1929a7 req-3048a7af-02b0-49e1-b0ba-ffd55807a4a5 tempest-FloatingIPsAssociationTestJSON-45960377 tempest-FloatingIPsAssociationTestJSON-45960377-project-member] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 986.522245] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGHEST for action security_group_members [ 986.522585] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.522707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.522781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.523018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.523200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.523889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.523889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.523889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.523889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.523889] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.031195] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.031195] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.031195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.034807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.034807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.034807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be updated. [ 987.066482] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.066874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.066874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.067781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.067781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.076862] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: IN_PROGRESS for 2s [ 988.084869] env[69350]: INFO networking_nsxv3.common.synchronization [req-1f56490b-d2d7-4f47-a488-bcf079fd6edf req-315090c5-8318-454a-8a5f-a5e1080bfb66 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 988.085438] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 988.085755] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.085880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.085948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.087717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.087951] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.088128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.088240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.088460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.088979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.089330] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.418741] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c3e54206-6b85-4826-a2b8-b6dda9441977 None None] Enqueued Resource ID: d3649c6f-e5e2-421f-9760-46a4df83cbf5 with Priority: HIGHEST for action port [ 988.420205] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3649c6f-e5e2-421f-9760-46a4df83cbf5 with Priority: HIGHEST for action port [ 988.420205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3649c6f-e5e2-421f-9760-46a4df83cbf5 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.420205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3649c6f-e5e2-421f-9760-46a4df83cbf5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.420205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3649c6f-e5e2-421f-9760-46a4df83cbf5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.420508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3649c6f-e5e2-421f-9760-46a4df83cbf5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.420620] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3649c6f-e5e2-421f-9760-46a4df83cbf5',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.591908] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.685018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.685018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.685018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.686110] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.686524] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.686883] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.687244] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.687497] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.689649] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.689649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.710286] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.710286] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.710286] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.710286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.710286] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-8382e22c-a6de-4cb1-9ea9-0b237e588b45 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.710286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.710286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.710816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.711116] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8382e22c-a6de-4cb1-9ea9-0b237e588b45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.924915] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3649c6f-e5e2-421f-9760-46a4df83cbf5 [ 988.925172] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.925310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.925380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.925604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.925683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.925782] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3649c6f-e5e2-421f-9760-46a4df83cbf5 already deleted. [ 988.925863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3649c6f-e5e2-421f-9760-46a4df83cbf5" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.088390] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e075408-82f5-4e52-84f7-426a04568f7e in Status: SUCCESS [ 989.088779] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e deletion is rescheduled due to dependency. [ 989.088779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.095354] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.218021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.218021] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 8382e22c-a6de-4cb1-9ea9-0b237e588b45 not found, creating... [ 989.218021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.218021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.218706] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.219045] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.219330] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.219685] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.220057] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.220346] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 8382e22c-a6de-4cb1-9ea9-0b237e588b45 is going to be created. [ 989.249020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.249020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.249020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.249020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.249020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.249020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.570361] env[69350]: INFO networking_nsxv3.common.synchronization [req-12cd1892-ec48-4d63-8cee-1006c6ed7bf9 req-ce0fa585-832e-47a8-8be7-90375d2469da tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 989.574982] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 989.575450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.575557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.575596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.576266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.576266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.576266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.576266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.576534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.576534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.576534] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.597305] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.597535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.597931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.598219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.598316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.598420] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 989.643363] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.643592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.643592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.643808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.644083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.659956] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 990.078785] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.368917] env[69350]: INFO networking_nsxv3.common.synchronization [req-1f56490b-d2d7-4f47-a488-bcf079fd6edf req-03ce44bf-b689-4e19-9032-1c356af18e6a service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 990.369204] env[69350]: INFO networking_nsxv3.common.synchronization [req-1f56490b-d2d7-4f47-a488-bcf079fd6edf req-03ce44bf-b689-4e19-9032-1c356af18e6a service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 990.369290] env[69350]: INFO networking_nsxv3.common.synchronization [req-1f56490b-d2d7-4f47-a488-bcf079fd6edf req-03ce44bf-b689-4e19-9032-1c356af18e6a service nova] Enqueued Resource ID: 8382e22c-a6de-4cb1-9ea9-0b237e588b45 with Priority: HIGHEST for action port [ 990.369871] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 990.370777] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 990.370979] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8382e22c-a6de-4cb1-9ea9-0b237e588b45 with Priority: HIGHEST for action port [ 990.371758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.371933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.372055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.372241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.372325] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.373294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.373404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.373592] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8382e22c-a6de-4cb1-9ea9-0b237e588b45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.373689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.373755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.373934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.374020] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8382e22c-a6de-4cb1-9ea9-0b237e588b45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.581892] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.676346] env[69350]: INFO networking_nsxv3.common.synchronization [None req-97e5443d-ecc8-45ea-8e76-3a47ab73240b None None] Enqueued Resource ID: e32ec95d-9d36-4b23-a63d-483aa3905eb1 with Priority: HIGHEST for action port [ 990.676346] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32ec95d-9d36-4b23-a63d-483aa3905eb1 with Priority: HIGHEST for action port [ 990.676346] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e32ec95d-9d36-4b23-a63d-483aa3905eb1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.676346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e32ec95d-9d36-4b23-a63d-483aa3905eb1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.676346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e32ec95d-9d36-4b23-a63d-483aa3905eb1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.676738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e32ec95d-9d36-4b23-a63d-483aa3905eb1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.676738] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e32ec95d-9d36-4b23-a63d-483aa3905eb1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.880079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.880079] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8382e22c-a6de-4cb1-9ea9-0b237e588b45 with status ACTIVE [ 990.880079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.880079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.880079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.880079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.880857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.880857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.880857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.880857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.880857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8382e22c-a6de-4cb1-9ea9-0b237e588b45 is going to be updated. [ 990.905094] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.905289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.905337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.905521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.905656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.905819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8382e22c-a6de-4cb1-9ea9-0b237e588b45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.920928] env[69350]: INFO networking_nsxv3.common.synchronization [req-154c6e19-1d1e-4bbb-a31d-cd080f431193 req-d453fe1f-a5e2-451c-9774-2759ef24ba27 tempest-MigrationsAdminTest-200317129 tempest-MigrationsAdminTest-200317129-project-member] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 990.922263] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGHEST for action security_group_members [ 990.922263] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.922263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.922263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.922836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.923088] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.923253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.923325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.925980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.926173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.926689] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.086161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.086161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.086161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.086161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.086161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.086446] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 991.120093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.120382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.120382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.121072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.121072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.132297] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 991.181884] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e32ec95d-9d36-4b23-a63d-483aa3905eb1 [ 991.182677] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.182910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.183067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.183355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.183513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.183773] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e32ec95d-9d36-4b23-a63d-483aa3905eb1 already deleted. [ 991.183773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e32ec95d-9d36-4b23-a63d-483aa3905eb1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.187903] env[69350]: INFO networking_nsxv3.common.synchronization [None req-217d8b6e-a147-44de-ad72-0a825c3a8e5e tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 991.188297] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 991.189916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.190134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.432732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.432732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.432732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.432732] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be updated. [ 991.466313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.471191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.471191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.471191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.471191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.483054] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: IN_PROGRESS for 2s [ 991.677159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.677159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.677159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.677159] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.181242] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.685355] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.775787] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3ed7231b-d9ab-4730-b8cf-50ff2e4c2a11 None None] Enqueued Resource ID: 1b01b1bc-1008-4b59-af74-8e20890ffb92 with Priority: HIGHEST for action port [ 992.776399] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b01b1bc-1008-4b59-af74-8e20890ffb92 with Priority: HIGHEST for action port [ 992.776716] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b01b1bc-1008-4b59-af74-8e20890ffb92 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.780236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b01b1bc-1008-4b59-af74-8e20890ffb92" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.780310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b01b1bc-1008-4b59-af74-8e20890ffb92" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.780596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b01b1bc-1008-4b59-af74-8e20890ffb92" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.780683] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b01b1bc-1008-4b59-af74-8e20890ffb92',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.855791] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c2d9c900-625c-4079-b0de-b94ebb149a92 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 992.856314] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 992.856619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.856739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.856801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.857170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.857267] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.024839] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a4fb51bb-c4d5-4ba0-a9d2-b869637356c2 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 993.027276] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 993.027727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.027887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.148181] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.148181] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.148181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.148181] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.190446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.190532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.190573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.190788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.190914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.191001] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 993.225288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.225431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.228028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.228028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.228028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.240648] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 993.284693] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b01b1bc-1008-4b59-af74-8e20890ffb92 [ 993.284693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.284693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.284693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.284693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.284693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.284693] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b01b1bc-1008-4b59-af74-8e20890ffb92 already deleted. [ 993.284693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b01b1bc-1008-4b59-af74-8e20890ffb92" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.382544] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.382544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.382544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.382544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.382544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.382544] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f already deleted. [ 993.382853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.382853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.382972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.383018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.495725] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 in Status: SUCCESS [ 993.495725] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 deletion is rescheduled due to dependency. [ 993.495725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.654334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.654334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.654334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.654334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 993.682298] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.682298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.682298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.682298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.682298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.689817] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 993.910900] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.910900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.910900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.910900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.910900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.910900] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f already deleted. [ 993.910900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.964975] env[69350]: INFO networking_nsxv3.common.synchronization [None req-8f366f0c-2629-419b-9db4-0ec378174fc8 None None] Enqueued Resource ID: 163ad09d-1457-426a-a6e5-773016ef96cf with Priority: HIGHEST for action port [ 993.964975] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163ad09d-1457-426a-a6e5-773016ef96cf with Priority: HIGHEST for action port [ 993.964975] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-163ad09d-1457-426a-a6e5-773016ef96cf taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.964975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163ad09d-1457-426a-a6e5-773016ef96cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.964975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163ad09d-1457-426a-a6e5-773016ef96cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.966140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163ad09d-1457-426a-a6e5-773016ef96cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.966973] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163ad09d-1457-426a-a6e5-773016ef96cf',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.384139] env[69350]: INFO networking_nsxv3.common.synchronization [req-bd805178-8a56-4994-b644-2b2ac81a86bb req-d6b1d209-b1b3-4e20-88d5-11f1a5d5ed16 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 994.384139] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGHEST for action security_group_members [ 994.384865] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.384865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.384865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.384865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.386180] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.388112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.388206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.388502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.388600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.388704] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.468622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 163ad09d-1457-426a-a6e5-773016ef96cf [ 994.469320] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.469320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.469320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.469320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.469524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.469524] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:163ad09d-1457-426a-a6e5-773016ef96cf already deleted. [ 994.469590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163ad09d-1457-426a-a6e5-773016ef96cf" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.892141] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.892602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.892602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.892602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.892834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.892898] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.892991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.893208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.894397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.894586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.894719] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e is going to be updated. [ 994.932591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.932729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.932787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.933062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.934515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.950894] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: IN_PROGRESS for 2s [ 994.953860] env[69350]: INFO networking_nsxv3.common.synchronization [None req-18333856-be1f-4c6e-ab35-2ded5c6463d2 None None] Enqueued Resource ID: 2d1827ed-d3b5-47df-95d8-d8e38b985645 with Priority: HIGHEST for action port [ 994.954691] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1827ed-d3b5-47df-95d8-d8e38b985645 with Priority: HIGHEST for action port [ 994.955119] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d1827ed-d3b5-47df-95d8-d8e38b985645 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.955297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d1827ed-d3b5-47df-95d8-d8e38b985645" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.955366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d1827ed-d3b5-47df-95d8-d8e38b985645" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.955759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d1827ed-d3b5-47df-95d8-d8e38b985645" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.955837] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d1827ed-d3b5-47df-95d8-d8e38b985645',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.254337] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.254337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.254337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.254337] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.410067] env[69350]: INFO networking_nsxv3.common.synchronization [req-42446317-6b6a-437f-976e-0c324eda5d16 req-047a7871-3aa0-41f6-8254-74c796054559 tempest-ServerGroupTestJSON-1839925466 tempest-ServerGroupTestJSON-1839925466-project-member] Enqueued Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 995.412015] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 995.412015] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.412332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.412517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.414028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.414028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.414166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.414217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.414450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.414790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.414790] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.465778] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d1827ed-d3b5-47df-95d8-d8e38b985645 [ 995.466013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.466941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.466941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.466941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.466941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.466941] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d1827ed-d3b5-47df-95d8-d8e38b985645 already deleted. [ 995.466941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d1827ed-d3b5-47df-95d8-d8e38b985645" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.699703] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 995.702027] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d deletion is rescheduled due to dependency. [ 995.702027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.758090] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.758090] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.758090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.762148] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.762148] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.762148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.762148] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.917478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.917958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.920434] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.920434] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 already deleted. [ 995.920434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.948060] env[69350]: INFO networking_nsxv3.common.synchronization [None req-23024eb7-9d32-41c8-8e32-ba1d224846ca tempest-ServerActionsV293TestJSON-1388554867 tempest-ServerActionsV293TestJSON-1388554867-project-member] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 995.948060] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 995.948060] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.948060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.948060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.948060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.948060] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.969025] env[69350]: INFO networking_nsxv3.common.synchronization [None req-42210a38-da8d-4925-9c6f-3286528107f7 None None] Enqueued Resource ID: 210b076d-51f6-4ac4-ad57-16cc446f7e47 with Priority: HIGHEST for action port [ 995.969403] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b076d-51f6-4ac4-ad57-16cc446f7e47 with Priority: HIGHEST for action port [ 995.969762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-210b076d-51f6-4ac4-ad57-16cc446f7e47 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.969897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-210b076d-51f6-4ac4-ad57-16cc446f7e47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.969990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-210b076d-51f6-4ac4-ad57-16cc446f7e47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.970960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-210b076d-51f6-4ac4-ad57-16cc446f7e47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.970960] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('210b076d-51f6-4ac4-ad57-16cc446f7e47',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.248464] env[69350]: INFO networking_nsxv3.common.synchronization [None req-e907200d-b0ae-4c75-898d-1c24c46ed6f5 tempest-ServerActionsV293TestJSON-1388554867 tempest-ServerActionsV293TestJSON-1388554867-project-member] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 996.249480] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 996.250287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.250287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.263157] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 996.287482] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.287642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.287709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.293351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.293471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.293749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.293870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.294015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.294151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.294218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.294418] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.294520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.296411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.296602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.296687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.296897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.296999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.297072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.297229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.297306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.297396] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 996.352893] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.352893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.352893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.353173] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.353372] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.353484] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.353517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.353736] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.353875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.354249] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.354378] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.355065] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.355266] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.355394] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.355509] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.355653] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.360316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.360478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.360538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.360758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.360865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.380571] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.380707] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.380845] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.381047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.381371] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9ed277bb-f0ea-435e-a1e5-a07628e4df03 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.385621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.385621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.385621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.385621] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed277bb-f0ea-435e-a1e5-a07628e4df03',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.414107] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 996.474413] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 210b076d-51f6-4ac4-ad57-16cc446f7e47 [ 996.474648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.474780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.474861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.475126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.475218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.475313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:210b076d-51f6-4ac4-ad57-16cc446f7e47 already deleted. [ 996.475405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-210b076d-51f6-4ac4-ad57-16cc446f7e47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.496725] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.496725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.496725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.496725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.496725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.496725] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b already deleted. [ 996.496725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.497692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.497867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.497867] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.887037] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.888691] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.888895] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.889264] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.889473] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.889677] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 9ed277bb-f0ea-435e-a1e5-a07628e4df03 not found, creating... [ 996.890014] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.890239] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.890399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.891027] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.891027] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.891208] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.891417] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.891574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.894765] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.894765] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.894765] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9ed277bb-f0ea-435e-a1e5-a07628e4df03 is going to be created. [ 996.916610] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.916843] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.916974] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.917286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.917530] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.917769] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.958895] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e in Status: SUCCESS [ 996.959168] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e deletion is rescheduled due to dependency. [ 996.959298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.037432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.037604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.037733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.038073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.038073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.038193] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b already deleted. [ 997.038231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.097615] env[69350]: INFO networking_nsxv3.common.synchronization [None req-987975a4-f48a-453c-b43a-f377dea54aec None None] Enqueued Resource ID: a2aa800c-5cf3-4fcf-895a-57af0fef11be with Priority: HIGHEST for action port [ 997.097902] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2aa800c-5cf3-4fcf-895a-57af0fef11be with Priority: HIGHEST for action port [ 997.098538] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2aa800c-5cf3-4fcf-895a-57af0fef11be taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.098813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2aa800c-5cf3-4fcf-895a-57af0fef11be" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.098813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2aa800c-5cf3-4fcf-895a-57af0fef11be" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.099010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2aa800c-5cf3-4fcf-895a-57af0fef11be" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.099099] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2aa800c-5cf3-4fcf-895a-57af0fef11be',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.603305] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2aa800c-5cf3-4fcf-895a-57af0fef11be [ 997.603545] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.603646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.605075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.605075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.605075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.605075] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2aa800c-5cf3-4fcf-895a-57af0fef11be already deleted. [ 997.605075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2aa800c-5cf3-4fcf-895a-57af0fef11be" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.017730] env[69350]: INFO networking_nsxv3.common.synchronization [req-42446317-6b6a-437f-976e-0c324eda5d16 req-c4827575-4090-406e-95db-0fdd45d23071 service nova] Enqueued Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_rules [ 998.018307] env[69350]: INFO networking_nsxv3.common.synchronization [req-42446317-6b6a-437f-976e-0c324eda5d16 req-c4827575-4090-406e-95db-0fdd45d23071 service nova] Enqueued Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 998.018483] env[69350]: INFO networking_nsxv3.common.synchronization [req-42446317-6b6a-437f-976e-0c324eda5d16 req-c4827575-4090-406e-95db-0fdd45d23071 service nova] Enqueued Resource ID: 9ed277bb-f0ea-435e-a1e5-a07628e4df03 with Priority: HIGHEST for action port [ 998.018726] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_rules [ 998.018857] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 998.018958] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed277bb-f0ea-435e-a1e5-a07628e4df03 with Priority: HIGHEST for action port [ 998.025157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.025228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.025295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.025553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.026840] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.029932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.030090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.030158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.030682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.030682] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.031082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.031082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.031082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.031082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.031200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.032117] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ed277bb-f0ea-435e-a1e5-a07628e4df03 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.032204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.032288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.034795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.034795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed277bb-f0ea-435e-a1e5-a07628e4df03',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.437123] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 998.437408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.538396] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.538396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.538396] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ed277bb-f0ea-435e-a1e5-a07628e4df03 with status ACTIVE [ 998.538396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.538396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.538396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.538950] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.538950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.538950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.538950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.538950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.538950] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ed277bb-f0ea-435e-a1e5-a07628e4df03 is going to be updated. [ 998.566566] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.567140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.567253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.567527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.568744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.568744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ed277bb-f0ea-435e-a1e5-a07628e4df03" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.963601] env[69350]: INFO networking_nsxv3.common.synchronization [req-e32a4d59-3b24-4ace-9fdb-9382867c0dac req-af613120-d96e-49bd-880a-7785fe7ddef6 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 998.966167] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 998.966167] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.966167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.966167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.966167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.966167] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.966167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.966167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.966909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.966909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.966909] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.042560] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.408736] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.408950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.409095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.409369] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.409625] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.409786] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.409907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.410145] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.410295] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.410505] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.410656] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.410733] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.410844] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.410954] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.411076] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.411237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.430419] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.430586] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 999.430732] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.430919] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.431267] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e4da15c3-07cd-457f-982d-4f8bf20746fc taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.431440] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.431560] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.431911] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.432070] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4da15c3-07cd-457f-982d-4f8bf20746fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.469055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.469394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.469521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.469868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.470337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.470337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.470337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.470714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.470714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.470714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.470714] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 already deleted. [ 999.470820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.544916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.545278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.545424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.545787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.545892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.545995] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 is going to be created. [ 999.572492] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.572636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.572708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.572923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.573113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.582811] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: UNINITIALIZED for 2s [ 999.795439] env[69350]: INFO networking_nsxv3.common.synchronization [req-148dd084-3d72-47b5-aacc-7bb2d3f726af req-97c6366c-eb00-4c2f-9045-cf8d935fc972 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 999.796082] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 999.796476] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.796605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.796673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.796896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.797081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.797191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.797253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.797408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.797481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.797582] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.937981] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.937981] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port e4da15c3-07cd-457f-982d-4f8bf20746fc not found, creating... [ 999.937981] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.937981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.938699] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.938699] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.938699] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.938699] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.938699] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.938699] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e4da15c3-07cd-457f-982d-4f8bf20746fc is going to be created. [ 999.959278] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.959499] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.959790] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.959953] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.960207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.960460] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.299732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.300162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.300162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.300228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.300366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.300522] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.300674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.300674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.300870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.300980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.301189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1000.338569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.339094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.339094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.339094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.339222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.350844] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [req-e32a4d59-3b24-4ace-9fdb-9382867c0dac req-66b377c9-04b1-42c6-8185-4dd68e181ec3 service nova] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [req-e32a4d59-3b24-4ace-9fdb-9382867c0dac req-66b377c9-04b1-42c6-8185-4dd68e181ec3 service nova] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [req-e32a4d59-3b24-4ace-9fdb-9382867c0dac req-66b377c9-04b1-42c6-8185-4dd68e181ec3 service nova] Enqueued Resource ID: e4da15c3-07cd-457f-982d-4f8bf20746fc with Priority: HIGHEST for action port [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1001.294039] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4da15c3-07cd-457f-982d-4f8bf20746fc with Priority: HIGHEST for action port [ 1001.302023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.302023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.302023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.302023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.302023] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.302023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.302648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.302791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.303048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.303262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.303406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.303499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.304130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.304311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.304477] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.305531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4da15c3-07cd-457f-982d-4f8bf20746fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.306177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.306296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.306649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.306763] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4da15c3-07cd-457f-982d-4f8bf20746fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.597693] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: SUCCESS [ 1001.597693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.597693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.597693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.597693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.598052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.598052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.598052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.598151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.598217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.598307] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.808807] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.809884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.810038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.811401] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4da15c3-07cd-457f-982d-4f8bf20746fc with status ACTIVE [ 1001.811401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.811401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.811401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.811804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.811804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.811804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.811804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.811804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.811980] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4da15c3-07cd-457f-982d-4f8bf20746fc is going to be updated. [ 1001.820241] env[69350]: INFO networking_nsxv3.common.synchronization [req-12bdbb66-cd77-4c50-84b8-79259f3988ed req-ef1f8467-8668-492a-b90d-1fe4b4414903 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1001.820526] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1001.820688] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.822061] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.822061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.822061] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.835420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.835598] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.835641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.836425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.836581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.836763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.100582] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.100786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.100863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.101113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.101288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.101393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.101446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.101600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.101688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.101775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.101982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.102120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.102181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.102326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.102468] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.102560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.102621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.102760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.102837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.102944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.104201] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.113310] env[69350]: INFO networking_nsxv3.common.synchronization [req-41413bac-b998-4f4f-be20-f658a4baa98a req-fb159fae-b4cd-4587-98a5-40e73a02069a tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1002.113994] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1002.114805] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.114936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.115145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.115426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.115618] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.115703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.115784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.115955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.116091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.116199] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.313811] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.327091] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.327237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.327297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.327540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.327633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.327952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.328056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.328105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.328266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.328344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.328434] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1002.363013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.363165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.363222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.363479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.363630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.365869] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1002.365987] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1002.366107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.374197] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1002.606907] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c424677c-a7b4-455f-b6cc-392100496fd8: rpc.has_security_group_logging(os_id): False [ 1002.623749] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.632059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.632059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.632059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.632059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.632709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.632709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.632709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.632709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.632709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.632709] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 is going to be created. [ 1002.697220] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.697368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.697441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.697657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.697869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.708611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: IN_PROGRESS for 2s [ 1002.818704] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.818704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.818704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.818704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.818704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.818704] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be created. [ 1002.850185] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.850381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.850381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.850584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.850745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.859917] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: UNINITIALIZED for 2s [ 1003.134631] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.640564] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.640908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.640908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.641031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.641157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.641230] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1003.676032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.676032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.676032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.676032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.676032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.684849] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1004.385669] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1004.385669] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1004.385669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.724825] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: SUCCESS [ 1004.725118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.874433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: SUCCESS [ 1004.874725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.874870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.875273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.875326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.875478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.875527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.875691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.875774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.875860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.875952] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.380128] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.555023] env[69350]: INFO networking_nsxv3.common.synchronization [req-41247425-1659-4471-b3ee-bb34ffdc27c3 req-f625e965-3168-4141-9bbd-a7f6569fe919 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1005.555119] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1005.555391] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.555529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.555605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.555868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.556242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.556381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.556448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.556614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.556887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.557057] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.698266] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1005.698535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.884547] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0eab42b-aa65-450c-a7c9-ef9dfeea65c1: rpc.has_security_group_logging(os_id): False [ 1005.890405] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.890661] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.890851] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.891216] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.891493] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.891669] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.891828] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.892645] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.892904] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.894022] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.894161] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.894346] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.894419] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.894603] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.894775] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.894927] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.906612] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.906866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.906866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.907085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.907182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.907435] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.907527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.907594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.907754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.907829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.907917] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be created. [ 1005.917252] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.917461] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1005.917618] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.917799] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-281" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.918144] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-36e025b6-1bbd-4372-a17c-ef4e25e53042 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.918390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.918481] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.918802] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.918941] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36e025b6-1bbd-4372-a17c-ef4e25e53042',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.957152] env[69350]: INFO networking_nsxv3.common.synchronization [None req-ecbe8745-23eb-43f7-94ca-ae8d57232591 None None] Enqueued Resource ID: 71ebf0f4-a57f-43a5-8948-18e33f22ca2e with Priority: HIGHEST for action port [ 1005.957441] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ebf0f4-a57f-43a5-8948-18e33f22ca2e with Priority: HIGHEST for action port [ 1005.958039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ebf0f4-a57f-43a5-8948-18e33f22ca2e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.958207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ebf0f4-a57f-43a5-8948-18e33f22ca2e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.958249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ebf0f4-a57f-43a5-8948-18e33f22ca2e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.958493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ebf0f4-a57f-43a5-8948-18e33f22ca2e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.958575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ebf0f4-a57f-43a5-8948-18e33f22ca2e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.979988] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.979988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.979988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.979988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.992510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: IN_PROGRESS for 2s [ 1006.060556] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.060764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.060810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.061079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.061178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.061400] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.061503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.061567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.061738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.061816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.061904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe already deleted. [ 1006.062020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.424772] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.426337] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.427124] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.427124] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.427227] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.427383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 36e025b6-1bbd-4372-a17c-ef4e25e53042 not found, creating... [ 1006.428884] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.429085] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.429218] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.429470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.429618] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.430747] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.430850] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.431441] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.431441] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.431636] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.431799] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 is going to be created. [ 1006.464320] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ebf0f4-a57f-43a5-8948-18e33f22ca2e [ 1006.464613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.464771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.464841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.465077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.465571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.465571] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ebf0f4-a57f-43a5-8948-18e33f22ca2e already deleted. [ 1006.465571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ebf0f4-a57f-43a5-8948-18e33f22ca2e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.480570] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.480811] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.481015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.481326] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.481595] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.482276] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.259381] env[69350]: INFO networking_nsxv3.common.synchronization [None req-02f31ba6-da12-4807-9596-b071d3cbc537 tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1007.259908] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1007.260230] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.260943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.260943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.260943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.260943] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.479140] env[69350]: INFO networking_nsxv3.common.synchronization [req-41247425-1659-4471-b3ee-bb34ffdc27c3 req-523a09b0-2aef-49a4-a9ee-897a835e63b6 service nova] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1007.479375] env[69350]: INFO networking_nsxv3.common.synchronization [req-41247425-1659-4471-b3ee-bb34ffdc27c3 req-523a09b0-2aef-49a4-a9ee-897a835e63b6 service nova] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1007.479560] env[69350]: INFO networking_nsxv3.common.synchronization [req-41247425-1659-4471-b3ee-bb34ffdc27c3 req-523a09b0-2aef-49a4-a9ee-897a835e63b6 service nova] Enqueued Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1007.481482] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1007.481635] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1007.481741] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1007.482817] env[69350]: INFO networking_nsxv3.common.synchronization [None req-42ef85b5-a2e6-4606-8943-600bf06a031d tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1007.483248] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.483387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.483850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.483850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.483850] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.484907] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.485050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.485123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.486046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.486046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.486046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.486046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.486046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.486046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.486046] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.487068] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-36e025b6-1bbd-4372-a17c-ef4e25e53042 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.487215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.487317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.487472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.487573] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36e025b6-1bbd-4372-a17c-ef4e25e53042',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.488597] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1007.489717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.489717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.787925] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.787925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.787925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.788340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.788340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.788420] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 already deleted. [ 1007.788472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.788652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.788834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.788934] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.991522] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.991522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.991522] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.993413] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36e025b6-1bbd-4372-a17c-ef4e25e53042 with status ACTIVE [ 1007.993717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.995979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.995979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.996327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.996327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.996443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.996516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.996560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.996732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.996842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.997104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.997430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.997430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.997562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.997656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.997727] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 is going to be updated. [ 1008.032868] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: SUCCESS [ 1008.033167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.040531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.040531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.040531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.040855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.041092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.041191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.316360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.316657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.316657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.316827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.316919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.317019] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 already deleted. [ 1008.317117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.437038] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d2df032f-b7f4-4ca8-96ec-0e29b834cfbe None None] Enqueued Resource ID: 5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff with Priority: HIGHEST for action port [ 1008.437458] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff with Priority: HIGHEST for action port [ 1008.438296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.438476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.438576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.442024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.442024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.501536] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.623021] env[69350]: INFO networking_nsxv3.common.synchronization [None req-fba40710-853f-49bc-a494-9ca972a23f4c None None] Enqueued Resource ID: 6efb8eb6-1683-43f3-8fa4-e7d577c0fd47 with Priority: HIGHEST for action port [ 1008.623021] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6efb8eb6-1683-43f3-8fa4-e7d577c0fd47 with Priority: HIGHEST for action port [ 1008.623021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6efb8eb6-1683-43f3-8fa4-e7d577c0fd47 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.623021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6efb8eb6-1683-43f3-8fa4-e7d577c0fd47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.623021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6efb8eb6-1683-43f3-8fa4-e7d577c0fd47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.623352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6efb8eb6-1683-43f3-8fa4-e7d577c0fd47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.623434] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6efb8eb6-1683-43f3-8fa4-e7d577c0fd47',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.942414] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff [ 1008.942664] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.942804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.942874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.943173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.944494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.944494] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff already deleted. [ 1008.944494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5edb82d1-9e1d-40a4-bfb4-f2bdafdb02ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.009521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.009521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.009521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.009521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.009521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.009521] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be created. [ 1009.058689] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.058874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.058950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.059221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.059484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076206] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: UNINITIALIZED for 2s [ 1009.127506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6efb8eb6-1683-43f3-8fa4-e7d577c0fd47 [ 1009.127757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.127890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.127958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.128197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.128284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.128380] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6efb8eb6-1683-43f3-8fa4-e7d577c0fd47 already deleted. [ 1009.128457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6efb8eb6-1683-43f3-8fa4-e7d577c0fd47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.430110] env[69350]: INFO networking_nsxv3.common.synchronization [req-48640f7e-5141-4e9c-9603-13ec09a1e7c0 req-92c8d3b6-fffb-42c2-a9f8-e6169993f6dd tempest-ServerGroupTestJSON-1839925466 tempest-ServerGroupTestJSON-1839925466-project-member] Enqueued Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 1010.430696] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGHEST for action security_group_members [ 1010.431021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.432536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.432622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.432836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.433011] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.433538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.433538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.433538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.433538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.433538] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.733931] env[69350]: INFO networking_nsxv3.common.synchronization [req-aff7c28e-5ecb-46ea-af64-cea0167a8aa2 req-2d0b68b7-1ca5-4a06-9363-6dcd304ea929 tempest-ServersTestManualDisk-690118913 tempest-ServersTestManualDisk-690118913-project-member] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 1010.734553] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGHEST for action security_group_members [ 1010.734873] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.734995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.735086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.736534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.736869] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.737400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.737664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.738129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.739187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.739187] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.936214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.940040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.940040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.940040] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 is going to be updated. [ 1010.977569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.977569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.977569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.977569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.977569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.989029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: IN_PROGRESS for 2s [ 1011.095936] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.095936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.095936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.095936] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.242562] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.242562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.242909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.243055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.243827] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.243827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.243827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.244303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.244303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.244477] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef is going to be updated. [ 1011.253052] env[69350]: INFO networking_nsxv3.common.synchronization [req-e77bcda0-17b5-4c88-ba43-613ddde88cd4 req-43ffbf76-0c42-4c8c-b99f-4c23825e5549 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1011.253052] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1011.253052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.253052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.253052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.253732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.255220] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.255432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.255553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.255838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.255994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.256162] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.282776] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.282926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.283163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.283571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.283571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.297664] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: IN_PROGRESS for 2s [ 1011.598306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.598306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.598306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.598714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.598714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.598846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.598920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.599126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.599231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.599319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.599466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.599573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.599635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.599804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.599943] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.600061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.600123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.600487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.600487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.600487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.600620] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.671742] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.671973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.672151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.672551] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.676301] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.676535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.676666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.676968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.677163] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.677397] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.677518] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.677637] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.677753] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.677880] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.678126] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.678157] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.702427] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.702618] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.702918] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.703082] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.703529] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-1a6042b7-9c64-469a-84af-cf1fa1988cc4 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.703739] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.704346] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.704734] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.704916] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a6042b7-9c64-469a-84af-cf1fa1988cc4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.763317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.763516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.763663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.763885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.763999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.764281] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.764411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.764511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.764688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.764771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.764862] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 already deleted. [ 1011.764946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.921262] env[69350]: INFO networking_nsxv3.common.synchronization [None req-cb60db70-b36e-4c40-951d-909506ed2a2e None None] Enqueued Resource ID: 565238d5-88ff-432e-a60b-59817bb09299 with Priority: HIGHEST for action port [ 1011.921262] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565238d5-88ff-432e-a60b-59817bb09299 with Priority: HIGHEST for action port [ 1011.921441] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-565238d5-88ff-432e-a60b-59817bb09299 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.921564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565238d5-88ff-432e-a60b-59817bb09299" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.921630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565238d5-88ff-432e-a60b-59817bb09299" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.921963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565238d5-88ff-432e-a60b-59817bb09299" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.923933] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565238d5-88ff-432e-a60b-59817bb09299',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.105634] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0447a165-64dd-4bdf-b4e3-0798d8b91abe: rpc.has_security_group_logging(os_id): False [ 1012.124801] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.125343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.125581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.125916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.126171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.126550] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.126799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.126962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.127255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.127451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.127855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.128122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.128287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.128563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.128742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.129069] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.129305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.129469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.129733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.129936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.130171] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be created. [ 1012.210640] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.211089] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.211328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.211762] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.212107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.212386] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 1a6042b7-9c64-469a-84af-cf1fa1988cc4 not found, creating... [ 1012.212879] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.214083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.214501] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.215160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.215538] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.216245] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.217203] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.217710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.217898] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.218234] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.218419] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 1a6042b7-9c64-469a-84af-cf1fa1988cc4 is going to be created. [ 1012.241817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.241999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.242144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.242430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.242719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.256340] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.256815] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.257093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.257510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.258018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.258376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.263431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1012.428560] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 565238d5-88ff-432e-a60b-59817bb09299 [ 1012.428922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.429074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.429166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.429474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.429572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.429669] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:565238d5-88ff-432e-a60b-59817bb09299 already deleted. [ 1012.429752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565238d5-88ff-432e-a60b-59817bb09299" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.002784] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c424677c-a7b4-455f-b6cc-392100496fd8 in Status: SUCCESS [ 1013.003276] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 deletion is rescheduled due to dependency. [ 1013.003276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.070391] env[69350]: INFO networking_nsxv3.common.synchronization [req-e77bcda0-17b5-4c88-ba43-613ddde88cd4 req-7b47a80e-67a8-401c-8439-f0efcd3c9c1f service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1013.070391] env[69350]: INFO networking_nsxv3.common.synchronization [req-e77bcda0-17b5-4c88-ba43-613ddde88cd4 req-7b47a80e-67a8-401c-8439-f0efcd3c9c1f service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1013.070391] env[69350]: INFO networking_nsxv3.common.synchronization [req-e77bcda0-17b5-4c88-ba43-613ddde88cd4 req-7b47a80e-67a8-401c-8439-f0efcd3c9c1f service nova] Enqueued Resource ID: 1a6042b7-9c64-469a-84af-cf1fa1988cc4 with Priority: HIGHEST for action port [ 1013.070752] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1013.070919] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1013.071038] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a6042b7-9c64-469a-84af-cf1fa1988cc4 with Priority: HIGHEST for action port [ 1013.071337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.071523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.071523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.071770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.071852] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.072777] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.072909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.072967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.073155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.073300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.073398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.073453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.073600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.073679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.073803] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.074547] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a6042b7-9c64-469a-84af-cf1fa1988cc4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.074677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.074745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.074857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.074930] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a6042b7-9c64-469a-84af-cf1fa1988cc4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.308627] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef in Status: SUCCESS [ 1013.308890] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef deletion is rescheduled due to dependency. [ 1013.309309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.577214] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.578658] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.578876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.578928] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a6042b7-9c64-469a-84af-cf1fa1988cc4 with status ACTIVE [ 1013.579111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.579265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.579265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.579593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.579593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.579695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.579833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.579833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.580110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.580110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.580287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.580407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.580407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.580507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.580600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.580655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a6042b7-9c64-469a-84af-cf1fa1988cc4 is going to be updated. [ 1013.604965] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.604965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.604965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.605161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.605408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.605560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a6042b7-9c64-469a-84af-cf1fa1988cc4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.083034] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.280220] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1014.280220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.586274] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.586546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.586684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.587091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.587280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.587472] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be created. [ 1014.613697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.613918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.613918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.614322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.614570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.626160] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: UNINITIALIZED for 2s [ 1016.122343] env[69350]: INFO networking_nsxv3.common.synchronization [None req-5f776c59-3164-4f62-995f-4415c9ec5079 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1016.122931] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1016.123269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.123395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.123464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.123721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.123803] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.217932] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3ab4c56e-ff20-4216-8c5c-a7522b6e5fa5 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1016.220172] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1016.220172] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.220172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.646983] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1016.647214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.648228] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.649175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.649175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.649175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.649175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.649175] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 already deleted. [ 1016.649328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.649424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.649592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.649856] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.649974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.650053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.650218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.650328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.650417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.650508] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.651384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.651545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.651687] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.154174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.154499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.154499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.154812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.155075] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.155313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.155413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.155594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.155719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.155842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.156032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.156147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.156239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.156403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.156548] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.156665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.156735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.156916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.157026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.157117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.157210] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.180671] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.180894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.180894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.181154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.181250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.181307] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 already deleted. [ 1017.181425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.660152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1017.681246] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.681529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.681642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.682023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.682176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.682655] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.682655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.682655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.682896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.682896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.683084] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.683156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.683304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.683512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.683512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.683714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.683803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.683902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.684067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.684127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.684259] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be created. [ 1017.763906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.764086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.764145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.764380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.764586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.779190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1018.459386] env[69350]: INFO networking_nsxv3.common.synchronization [req-cf4f7154-e6e6-4009-860b-d0112c2102b4 req-1958676a-89d1-4082-ac8b-15697e46b068 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1018.460314] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1018.460618] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.460874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.460874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.461152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.461287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.461399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.461399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.461504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.461750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.461750] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.808136] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.808136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.808136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.808136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.808136] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.808136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.808136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.808626] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.808949] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.809399] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.809851] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.810146] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.810393] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.810636] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.810893] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.811210] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.834015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.834015] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.834015] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.834015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.834015] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6ea14d1d-8461-489d-b03a-328290f59530 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.834015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.834015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.834015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.834015] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea14d1d-8461-489d-b03a-328290f59530',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.968555] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.972027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.972212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.972416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.972519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.972753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.974032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.974032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.974032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.974032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.974032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f already deleted. [ 1018.974032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.337317] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.337473] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.337617] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.339706] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6ea14d1d-8461-489d-b03a-328290f59530 not found, creating... [ 1019.339706] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.339706] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.339706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.340315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.340315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.340315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.340315] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6ea14d1d-8461-489d-b03a-328290f59530 is going to be created. [ 1019.367033] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.367033] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.367033] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.367340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.367571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.367837] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.800088] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1019.800088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.177294] env[69350]: INFO networking_nsxv3.common.synchronization [req-cf4f7154-e6e6-4009-860b-d0112c2102b4 req-f0ec5ad3-d49b-4d6b-92da-edeb411f9f55 service nova] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 1020.177505] env[69350]: INFO networking_nsxv3.common.synchronization [req-cf4f7154-e6e6-4009-860b-d0112c2102b4 req-f0ec5ad3-d49b-4d6b-92da-edeb411f9f55 service nova] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1020.177681] env[69350]: INFO networking_nsxv3.common.synchronization [req-cf4f7154-e6e6-4009-860b-d0112c2102b4 req-f0ec5ad3-d49b-4d6b-92da-edeb411f9f55 service nova] Enqueued Resource ID: 6ea14d1d-8461-489d-b03a-328290f59530 with Priority: HIGHEST for action port [ 1020.178224] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_rules [ 1020.178375] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1020.178478] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea14d1d-8461-489d-b03a-328290f59530 with Priority: HIGHEST for action port [ 1020.178798] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.179050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.184065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.184065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.184065] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.184443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.184581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.184648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.184848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.184998] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.185110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.185176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.185321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.185409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.185501] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.186306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea14d1d-8461-489d-b03a-328290f59530 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.186408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.188656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.188656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.188656] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea14d1d-8461-489d-b03a-328290f59530',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.685513] env[69350]: INFO networking_nsxv3.common.synchronization [req-9cdfe7b9-9db2-496b-b679-04d645574a4b req-fca6cb8e-e0f2-4497-a031-fa5534983546 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1020.685513] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1020.685513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.685674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.687091] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.687091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.687091] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.692384] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.692384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.692581] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.695101] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ea14d1d-8461-489d-b03a-328290f59530 with status ACTIVE [ 1020.695101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.695101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.695101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.695632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.695632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.695632] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.695632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.695632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.695632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.695947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.695947] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ea14d1d-8461-489d-b03a-328290f59530 is going to be updated. [ 1020.721908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.721908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.721908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.721908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.721908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.722268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea14d1d-8461-489d-b03a-328290f59530" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.189741] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.190241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.190241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.190447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.190559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.190821] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.190959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.191073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.191294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.191481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.191567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1021.194800] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.221808] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.221994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.222081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.222336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.222501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.233440] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1021.270550] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.270550] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.270550] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.270550] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.271353] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.271611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.271805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.272176] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.272393] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.272658] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.272832] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.272996] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.273222] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.273423] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.273613] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.273803] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.295596] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.295825] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.296096] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.296304] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.296643] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-b98625f4-2ced-46b5-9f3e-4add40cc490e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.296858] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.297015] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.297381] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.297560] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b98625f4-2ced-46b5-9f3e-4add40cc490e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.697165] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.697326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.697398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.697620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.697707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.697803] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f is going to be created. [ 1021.723758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.723889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.723927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.724174] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.724360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.735269] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: UNINITIALIZED for 2s [ 1021.799912] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.800479] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.800670] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.801051] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.801272] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.801486] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port b98625f4-2ced-46b5-9f3e-4add40cc490e not found, creating... [ 1021.801918] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.802198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.802344] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.802615] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.802764] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.803122] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.803374] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.803527] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.803810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.803961] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.804176] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: b98625f4-2ced-46b5-9f3e-4add40cc490e is going to be created. [ 1021.826751] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.827027] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.827126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.827423] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.827658] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.827938] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.598944] env[69350]: INFO networking_nsxv3.common.synchronization [req-9cdfe7b9-9db2-496b-b679-04d645574a4b req-e90298df-088d-41f5-9914-2b0f4743fbd8 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1022.599265] env[69350]: INFO networking_nsxv3.common.synchronization [req-9cdfe7b9-9db2-496b-b679-04d645574a4b req-e90298df-088d-41f5-9914-2b0f4743fbd8 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1022.599346] env[69350]: INFO networking_nsxv3.common.synchronization [req-9cdfe7b9-9db2-496b-b679-04d645574a4b req-e90298df-088d-41f5-9914-2b0f4743fbd8 service nova] Enqueued Resource ID: b98625f4-2ced-46b5-9f3e-4add40cc490e with Priority: HIGHEST for action port [ 1022.600017] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1022.600538] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1022.600737] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98625f4-2ced-46b5-9f3e-4add40cc490e with Priority: HIGHEST for action port [ 1022.601402] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.601671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.601769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.602086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.602128] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.607053] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.608220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.608220] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b98625f4-2ced-46b5-9f3e-4add40cc490e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.608220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.608220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.608220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.608220] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b98625f4-2ced-46b5-9f3e-4add40cc490e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.109987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.110159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.110403] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b98625f4-2ced-46b5-9f3e-4add40cc490e with status ACTIVE [ 1023.110593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.110730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.110781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.110967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.111066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.111229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.111320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.111371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.111526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.111600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.111775] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.111866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.111925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.112076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.112152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.112257] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b98625f4-2ced-46b5-9f3e-4add40cc490e is going to be updated. [ 1023.134272] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.134272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.134272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.134470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.134560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.134716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b98625f4-2ced-46b5-9f3e-4add40cc490e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.164405] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-1a987689-b74a-4cec-aead-1098c9ab0b64 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1023.165606] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1023.166967] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.166967] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.166967] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.166967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.167137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.167365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.167498] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.167566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.170736] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.170736] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.170736] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.170736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.170736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.170736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.170736] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.171314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c72049-899b-462f-98bb-236d83d53839 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.171314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.171748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.171748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.171748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.171896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.171896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.171955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.172041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.172129] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.225283] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1023.225479] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.225627] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_rules [ 1023.225761] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.225899] env[69350]: INFO networking_nsxv3.common.synchronization [req-dd89380d-8c39-44c2-8a1c-1fe29da8f3a2 req-fb55fa3b-a68c-4d48-9db4-232bac94cba7 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1023.226502] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1023.226695] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_rules [ 1023.226739] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1023.226848] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.226972] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.227549] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.227705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.227778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.227993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.228098] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.229609] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c72049-899b-462f-98bb-236d83d53839 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.229736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.229824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.230116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.230225] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.234033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-36e025b6-1bbd-4372-a17c-ef4e25e53042 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.234033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.234033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.234033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.234033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36e025b6-1bbd-4372-a17c-ef4e25e53042',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.234033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.234033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.235778] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c72049-899b-462f-98bb-236d83d53839 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.235902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.251108] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1023.251616] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1023.251751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.252665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.252940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.253589] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.253742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.253879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.254120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.254215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.254320] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.670591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.671118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.671118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.671118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.671118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.671409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.671499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.671499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.671677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.671739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.671785] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 already deleted. [ 1023.671859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.673302] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.674255] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.738716] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36e025b6-1bbd-4372-a17c-ef4e25e53042 with status ACTIVE [ 1023.738922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.739063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.739127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.739341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.739554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.739641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.739723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.739774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.739886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.739960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.740167] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.740285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.740336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.740441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.740507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.740590] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 is going to be updated. [ 1023.744910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c72049-899b-462f-98bb-236d83d53839 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.745039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.745270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.745365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.755471] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: SUCCESS [ 1023.755471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.755714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.755894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.756224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.756224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.756503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.756699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.756699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.756699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.757015] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.761651] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.771727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.771862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.771862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.772099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.772322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.772490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.809192] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-db785e82-7d90-486c-9632-3f4968deea0d tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1023.809326] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1023.809705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.809705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.809881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.809962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.810737] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.810864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.810944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.811154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.811270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.811499] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.829107] env[69350]: INFO networking_nsxv3.common.synchronization [req-e48b5d67-cec7-467e-b7bc-5771c42f5568 req-4b42d92f-5166-456a-af17-1a24d1c4ad27 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.829206] env[69350]: INFO networking_nsxv3.common.synchronization [req-e48b5d67-cec7-467e-b7bc-5771c42f5568 req-4b42d92f-5166-456a-af17-1a24d1c4ad27 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.829773] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.829924] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c72049-899b-462f-98bb-236d83d53839 with Priority: HIGHEST for action security_group_members [ 1023.835758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.835758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.835758] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c72049-899b-462f-98bb-236d83d53839 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.835758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.926436] env[69350]: INFO networking_nsxv3.common.synchronization [req-e48b5d67-cec7-467e-b7bc-5771c42f5568 req-4b42d92f-5166-456a-af17-1a24d1c4ad27 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1023.926742] env[69350]: INFO networking_nsxv3.common.synchronization [req-e48b5d67-cec7-467e-b7bc-5771c42f5568 req-4b42d92f-5166-456a-af17-1a24d1c4ad27 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.926976] env[69350]: INFO networking_nsxv3.common.synchronization [req-e48b5d67-cec7-467e-b7bc-5771c42f5568 req-4b42d92f-5166-456a-af17-1a24d1c4ad27 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1023.927765] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_rules [ 1023.927995] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1023.928194] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 with Priority: HIGHEST for action port [ 1023.928576] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.928679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.929116] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.929116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.929287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-36e025b6-1bbd-4372-a17c-ef4e25e53042 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.929437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.929522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.929803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.929892] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36e025b6-1bbd-4372-a17c-ef4e25e53042',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.175802] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.180958] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.263788] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.263991] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.305685] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-c8e02303-78f2-49fa-9ea4-796bff8aa613 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1024.306583] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1024.306583] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.307317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.315340] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.315691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.315691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.315872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.315961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.316212] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.316334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.316416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.316615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.316742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.317370] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 already deleted. [ 1024.317509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.318084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.318195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.318367] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.318455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.318521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.318657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.318736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.319707] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.432949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36e025b6-1bbd-4372-a17c-ef4e25e53042 with status ACTIVE [ 1024.433199] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.433342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.433405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.433647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.433741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.433923] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.434036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.434098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.434262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.434331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.434536] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.434660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.434733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.434947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.434947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.435056] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36e025b6-1bbd-4372-a17c-ef4e25e53042 is going to be updated. [ 1024.455075] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.455234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.455297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.455495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.455634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.455793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36e025b6-1bbd-4372-a17c-ef4e25e53042" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.679650] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.679927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.679927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.680290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.680390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.680454] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1024.684317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.684454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.684576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.685173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.685400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.685573] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c72049-899b-462f-98bb-236d83d53839 is going to be created. [ 1024.718761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.718927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.719579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.719579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.719579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.730657] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.731383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.731504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.732017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.732017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.737920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c72049-899b-462f-98bb-236d83d53839 in Status: UNINITIALIZED for 2s [ 1024.743284] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1024.765963] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27c7362-80ef-4c99-9dd6-75361259db7f: rpc.has_security_group_logging(os_id): False [ 1024.768802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.768912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.768981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.769208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.769296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.769386] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1024.790459] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.790605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.790677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.790899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.790975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.791523] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.793799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.793799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.793799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.793799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.794095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f is going to be created. [ 1024.806806] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.807012] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.807192] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.807499] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.807750] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.807891] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.808017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.808254] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.808405] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.808620] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.809054] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.809148] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.809265] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.809360] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.809524] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.809677] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.824712] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.825935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.825935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.827567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.827567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.827567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 already deleted. [ 1024.827567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.831595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.831830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.831983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.832325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.832561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.845717] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1024.859389] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.859613] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.859763] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.859983] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.860379] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4e3fd1ea-969c-4eeb-b478-4be187231728 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.860558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.860681] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.862116] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.862390] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3fd1ea-969c-4eeb-b478-4be187231728',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.904343] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.905266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.905356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.905586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.905778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.920718] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: IN_PROGRESS for 2s [ 1025.365344] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.365615] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.366080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.366080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.366199] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.367037] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4e3fd1ea-969c-4eeb-b478-4be187231728 not found, creating... [ 1025.367037] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.367037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.367037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.367279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.367279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.368039] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.368230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.368342] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.368565] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.368716] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.369042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4e3fd1ea-969c-4eeb-b478-4be187231728 is going to be created. [ 1025.393359] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.393722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.393940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.394257] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.394566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.394836] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.246061] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-93776dae-fd6a-406f-a585-997c4ec28a3b service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1026.246361] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-93776dae-fd6a-406f-a585-997c4ec28a3b service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1026.246361] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-93776dae-fd6a-406f-a585-997c4ec28a3b service nova] Enqueued Resource ID: 4e3fd1ea-969c-4eeb-b478-4be187231728 with Priority: HIGHEST for action port [ 1026.246832] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1026.246991] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1026.247131] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e3fd1ea-969c-4eeb-b478-4be187231728 with Priority: HIGHEST for action port [ 1026.247526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.247526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.247666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.247893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.247980] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.248945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.252856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.252952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.253348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.254051] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.254051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.254051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.254617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.255015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.255015] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.256164] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e3fd1ea-969c-4eeb-b478-4be187231728 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.256289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.256781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.256781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.256781] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3fd1ea-969c-4eeb-b478-4be187231728',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.745041] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c72049-899b-462f-98bb-236d83d53839 in Status: SUCCESS [ 1026.745606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.746489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.746663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.746852] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.747012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.747091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.747231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.747853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.747853] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.756957] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1026.757112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.757767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.757767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.757767] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.757767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.757767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.758053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.758053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.758116] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.759611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.759611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.760313] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.760880] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e3fd1ea-969c-4eeb-b478-4be187231728 with status ACTIVE [ 1026.762133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.762133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.762133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.762133] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.762656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.762656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.762656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.762656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.762656] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e3fd1ea-969c-4eeb-b478-4be187231728 is going to be updated. [ 1026.786070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.786238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.786299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.786495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.786633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.786829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e3fd1ea-969c-4eeb-b478-4be187231728" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.857552] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.857552] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.857552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.858423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.858423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.858423] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.936694] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: SUCCESS [ 1026.936927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.013022] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.013236] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-121" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.013405] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-121" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.013984] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-121" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.014130] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.014198] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.014343] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.014597] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.014770] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.014979] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.015261] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.016030] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.016191] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.016325] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.016448] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.016593] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.036647] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.036647] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.036647] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.036647] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-121" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.036801] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-7878a487-0854-4e46-a9ce-e6dadf9603eb taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.036948] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.037066] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.037404] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.037555] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7878a487-0854-4e46-a9ce-e6dadf9603eb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.249879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.249879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.250599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.250599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.250599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.250599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.254126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.254126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.254126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.254126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.254126] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c72049-899b-462f-98bb-236d83d53839 is going to be deleted. [ 1027.260969] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.265544] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.294899] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.295063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.295132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.295358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.295453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.295552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.295698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.295847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.296013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.296115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.296179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.296318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.296418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.296476] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.364225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.364225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.364225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.364225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.364225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.364862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.364862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.364862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.364862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.364862] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.540857] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.541097] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.541230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.541530] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.541734] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.541838] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 7878a487-0854-4e46-a9ce-e6dadf9603eb not found, creating... [ 1027.542118] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.542528] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.542714] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.542962] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.543184] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.543426] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.543586] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.543706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.543929] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.544190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.544278] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 7878a487-0854-4e46-a9ce-e6dadf9603eb is going to be created. [ 1027.567706] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.567932] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.568083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.568390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.568846] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.569318] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.764066] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.769798] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.769798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.769944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.770119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.770237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.770340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be created. [ 1027.800600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.800785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.800890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.801156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.801267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.801505] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.801851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.801851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.801851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.802080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.802080] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c72049-899b-462f-98bb-236d83d53839 already deleted. [ 1027.802220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.802268] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.803195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.803392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.803561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.803691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.803764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.803923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.803998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.804304] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.809884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.810176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.810176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.810320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.810463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.825112] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: UNINITIALIZED for 2s [ 1027.867768] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f77ff482-c36b-41a0-9c84-caa4cc51cf3d: rpc.has_security_group_logging(os_id): False [ 1027.891413] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.891588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.891733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.891905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.892014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.892248] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.892383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.892383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.892554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.892627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.892837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.892959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.893055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.893219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.893311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.893521] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.893623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.893713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.893959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.893959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.894048] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1027.964781] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.967464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.967576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.967797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.967956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.984467] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1028.274593] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.274895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.274941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.275300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.275450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.275604] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1028.306668] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c72049-899b-462f-98bb-236d83d53839',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.307920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.308062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.308134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.308433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.308499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.308645] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.308870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.308870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.308953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.309015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.309115] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c72049-899b-462f-98bb-236d83d53839 already deleted. [ 1028.309171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.310765] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.310863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.310967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.311150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.311510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.321143] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1028.428961] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-4f32cc27-140b-41f1-8820-bd9ae42561be service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1028.429207] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-4f32cc27-140b-41f1-8820-bd9ae42561be service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1028.429358] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-4f32cc27-140b-41f1-8820-bd9ae42561be service nova] Enqueued Resource ID: 7878a487-0854-4e46-a9ce-e6dadf9603eb with Priority: HIGHEST for action port [ 1028.429647] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1028.429786] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1028.429891] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7878a487-0854-4e46-a9ce-e6dadf9603eb with Priority: HIGHEST for action port [ 1028.430472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.430581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.430792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.430875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.432575] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7878a487-0854-4e46-a9ce-e6dadf9603eb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.432876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.432876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.433772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.433772] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7878a487-0854-4e46-a9ce-e6dadf9603eb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.810380] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c72049-899b-462f-98bb-236d83d53839: rpc.has_security_group_logging(os_id): False [ 1028.828879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.829125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.829241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.829563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.829713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.830059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.830225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.830316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.830553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.830673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.833931] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c72049-899b-462f-98bb-236d83d53839 is going to be created. [ 1028.855307] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839], does not exist path=[/infra/domains/default/groups/18c72049-899b-462f-98bb-236d83d53839]."\n}' [ 1028.855531] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c72049-899b-462f-98bb-236d83d53839 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839 [ 1028.855651] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1028.895106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.895343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.895343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.895575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.897145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.897478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.897597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.897675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.897913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.898246] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.898369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.898450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.898602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.898806] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c72049-899b-462f-98bb-236d83d53839 is going to be created. [ 1028.918957] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839], does not exist path=[/infra/domains/default/groups/18c72049-899b-462f-98bb-236d83d53839]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839 [ 1028.919258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c72049-899b-462f-98bb-236d83d53839" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.919361] env[69350]: Traceback (most recent call last): [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1028.919416] env[69350]: return func(*args, **kwargs) [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1028.919416] env[69350]: res.raise_for_status() [ 1028.919416] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1028.919416] env[69350]: raise HTTPError(http_error_msg, response=self) [ 1028.919416] env[69350]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839 [ 1028.919416] env[69350]: During handling of the above exception, another exception occurred: [ 1028.919416] env[69350]: Traceback (most recent call last): [ 1028.919416] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1028.919416] env[69350]: listener.cb(fileno) [ 1028.919416] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1028.919416] env[69350]: result = function(*args, **kwargs) [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1028.919416] env[69350]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1028.919416] env[69350]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1028.919416] env[69350]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1028.919416] env[69350]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1028.919416] env[69350]: res.raise_for_status() [ 1028.919416] env[69350]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1028.919416] env[69350]: raise HTTPError(http_error_msg, response=self) [ 1028.919416] env[69350]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18c72049-899b-462f-98bb-236d83d53839 [ 1028.920286] env[69350]: Removing descriptor: 18 [ 1029.099630] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7878a487-0854-4e46-a9ce-e6dadf9603eb with status ACTIVE [ 1029.099797] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.099931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.099998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.100235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.104137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7878a487-0854-4e46-a9ce-e6dadf9603eb is going to be updated. [ 1029.159481] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.159784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.159784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.159960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.160270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.160460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7878a487-0854-4e46-a9ce-e6dadf9603eb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.468343] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.468750] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.468750] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.471574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.471971] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.472288] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.472497] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.472820] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.473060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.473735] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.473926] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.474760] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.474760] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.474760] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.474760] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.474760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.511962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.512084] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.512314] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.512603] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-699" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.512999] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.513305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.513385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.514021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.514021] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.559771] env[69350]: INFO networking_nsxv3.common.synchronization [req-8d8a42d4-bbf4-4a8f-9319-48e9f2b010ee req-9b2555b1-1ff6-47fa-96a4-7db5276f007a tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1029.560537] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1029.560865] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.560987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.561063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.561295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.561473] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.561615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.561658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.561824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.561922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.562029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.838644] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1029.838884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.839211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.839691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.839852] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.840044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.840165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.840480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.840480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.840646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.840646] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.841875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.842127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.842348] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.843799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.843799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.843799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.843799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.843799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.001389] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1030.001978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.017865] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.018171] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.018415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.018638] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.018893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.019087] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 not found, creating... [ 1030.019441] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.019616] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.019758] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.019998] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.020285] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.020489] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.021139] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.021139] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.021139] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.021495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.021712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 is going to be created. [ 1030.054671] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.054671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.054671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.054671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.054671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.054671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.068200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.068200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.068200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.068200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.085047] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.085047] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.085047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.085047] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.086222] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.086513] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.086751] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.087011] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.087235] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.087517] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.112019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.112019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.112019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.112019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.112019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.112019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.112019] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1030.121026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.121026] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.121026] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.121026] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.121798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-3a5a6886-9e51-4f19-9a25-cff31aebe77a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.123023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.123023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.123023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.123023] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5a6886-9e51-4f19-9a25-cff31aebe77a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.155219] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.155658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.155828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.156145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.156393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.165969] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1030.334159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.334159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.334159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.334159] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.336157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.336481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.336907] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.338134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.338134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.338134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.338134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.338134] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.351757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.352450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.352450] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.626700] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.627027] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.627164] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.627464] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.627646] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.627839] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 3a5a6886-9e51-4f19-9a25-cff31aebe77a not found, creating... [ 1030.628146] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.628334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.628480] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.628723] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.629025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.629177] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.629373] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.629530] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.629753] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.629894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.630051] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 3a5a6886-9e51-4f19-9a25-cff31aebe77a is going to be created. [ 1030.654469] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.654710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.655282] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.658629] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.658955] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.659210] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.837206] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.837353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.842380] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.844776] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-8a6d74ef-d5b4-48a2-bfd6-e4575a46c3b8 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1030.844959] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-8a6d74ef-d5b4-48a2-bfd6-e4575a46c3b8 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1030.845130] env[69350]: INFO networking_nsxv3.common.synchronization [req-4a5b29d5-519b-4443-9131-7c51919d5c7a req-8a6d74ef-d5b4-48a2-bfd6-e4575a46c3b8 service nova] Enqueued Resource ID: 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 with Priority: HIGHEST for action port [ 1030.845547] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1030.845681] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1030.845776] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 with Priority: HIGHEST for action port [ 1030.850445] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.850562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.850776] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.850860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.851050] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.851154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.851217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.851421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.851505] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.854986] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.065897] env[69350]: INFO networking_nsxv3.common.synchronization [req-c353630c-c5f1-4a4b-93e5-e8c443487e0a req-a6f959a6-b605-4604-bb92-305fea8bdcc0 tempest-ServerRescueTestJSONUnderV235-698594156 tempest-ServerRescueTestJSONUnderV235-698594156-project-member] Enqueued Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1031.065897] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe with Priority: HIGHEST for action security_group_members [ 1031.065897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.065897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.345922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.353910] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 with status ACTIVE [ 1031.354148] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.354278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.354346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.354631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.354739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.354922] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.355031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.355095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.355246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.355321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.355524] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.355649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.355713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.355877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.355957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.356050] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876 is going to be updated. [ 1031.357748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.357875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.357932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.358064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.358147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.358231] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1031.380531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.380733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.380776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.381006] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.381210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.381386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef5f9aa-fa63-4ccf-9aa4-eeadd1dab876" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.388642] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.388836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.388836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.389053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.389193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.399310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1031.745653] env[69350]: INFO networking_nsxv3.common.synchronization [req-8d8a42d4-bbf4-4a8f-9319-48e9f2b010ee req-697c672a-97fd-49a4-8677-be6619c90380 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1031.745930] env[69350]: INFO networking_nsxv3.common.synchronization [req-8d8a42d4-bbf4-4a8f-9319-48e9f2b010ee req-697c672a-97fd-49a4-8677-be6619c90380 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1031.745990] env[69350]: INFO networking_nsxv3.common.synchronization [req-8d8a42d4-bbf4-4a8f-9319-48e9f2b010ee req-697c672a-97fd-49a4-8677-be6619c90380 service nova] Enqueued Resource ID: 3a5a6886-9e51-4f19-9a25-cff31aebe77a with Priority: HIGHEST for action port [ 1031.746342] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1031.746549] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1031.746659] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a5a6886-9e51-4f19-9a25-cff31aebe77a with Priority: HIGHEST for action port [ 1031.747523] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.747628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.747628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.747835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.747926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.750617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.750617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.750617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a5a6886-9e51-4f19-9a25-cff31aebe77a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.750617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.750617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.750617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.750617] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5a6886-9e51-4f19-9a25-cff31aebe77a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.849187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.849187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.849187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.849187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.849187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.849447] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1031.887377] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.887531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.887602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.887819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.887967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.902776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1032.043882] env[69350]: INFO networking_nsxv3.common.synchronization [req-89e1758f-feb4-4e99-9017-aaa9108f0df7 req-f95620ae-73f4-43b0-a230-6e2f5562d27a tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1032.044479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1032.044788] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.044917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.044978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.045688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.046178] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.046291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.046461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.046520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.046601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.046696] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.177043] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1032.177235] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1032.177326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.178285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.178491] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.178771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.178771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.178968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.179245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.179392] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.254319] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a5a6886-9e51-4f19-9a25-cff31aebe77a with status ACTIVE [ 1032.254571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.254760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.254828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.255055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.255230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.255326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.255419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.255478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.255635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.257147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.257147] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.257147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.257147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.257147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.257147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.257147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a5a6886-9e51-4f19-9a25-cff31aebe77a is going to be updated. [ 1032.258050] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.258176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.280987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.281169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.281215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.281434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.281583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.281737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a5a6886-9e51-4f19-9a25-cff31aebe77a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.473911] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.474151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.474284] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.474674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.474948] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.475126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.475266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.475499] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.475654] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.475873] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.475989] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.476130] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.476244] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.476384] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.476508] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.476645] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.499229] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.499580] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.499727] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.499911] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.500309] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-2634defc-83f9-4615-a509-a5d9c774fed8 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.500535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.500672] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.501035] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.501161] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2634defc-83f9-4615-a509-a5d9c774fed8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.548845] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.549038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.549091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.549312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.549405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.549622] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.549724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.549787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.549946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.550032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550120] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 already deleted. [ 1032.550208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.681703] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.006147] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.006147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 2634defc-83f9-4615-a509-a5d9c774fed8 not found, creating... [ 1033.006147] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.006147] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.006816] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.006816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.006816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.006816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.006954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.007105] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 2634defc-83f9-4615-a509-a5d9c774fed8 is going to be created. [ 1033.028442] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.028592] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.028757] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.029233] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.029940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.030293] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.185395] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.412036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1033.412036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.412321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.412367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.412600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.412759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.412825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.412968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.413070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.413159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.413351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.413484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.413484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.413954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.413954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.413954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.413954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.414156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.414156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.414213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.414311] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.415926] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.415926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.415926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.690149] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.690149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.690149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.690431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.690431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.690431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1033.722958] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.723132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.723196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.723420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.723559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.732103] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1033.823480] env[69350]: INFO networking_nsxv3.common.synchronization [req-89e1758f-feb4-4e99-9017-aaa9108f0df7 req-61042b00-3259-442e-8d1b-9022bfa862ba service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1033.823694] env[69350]: INFO networking_nsxv3.common.synchronization [req-89e1758f-feb4-4e99-9017-aaa9108f0df7 req-61042b00-3259-442e-8d1b-9022bfa862ba service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1033.823870] env[69350]: INFO networking_nsxv3.common.synchronization [req-89e1758f-feb4-4e99-9017-aaa9108f0df7 req-61042b00-3259-442e-8d1b-9022bfa862ba service nova] Enqueued Resource ID: 2634defc-83f9-4615-a509-a5d9c774fed8 with Priority: HIGHEST for action port [ 1033.824560] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1033.824742] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1033.824875] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2634defc-83f9-4615-a509-a5d9c774fed8 with Priority: HIGHEST for action port [ 1033.825259] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.825461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.825509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.825748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.825855] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.826977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.827155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.827225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.827505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.827706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.827833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.827918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.828144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.828245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.828371] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.829375] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2634defc-83f9-4615-a509-a5d9c774fed8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.829564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.829661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.829852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.829941] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2634defc-83f9-4615-a509-a5d9c774fed8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.915737] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1033.915952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.916705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.917217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.917217] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.917217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.917458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.917458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.917578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.917633] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.918675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c926423-569b-4b98-81ac-723b20e82ff8: rpc.has_security_group_logging(os_id): False [ 1033.919777] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.940925] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.941173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.941231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.941404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.941507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.941714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.941833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.941897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.942118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.942203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.942461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.942552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.942619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.943569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.943569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.944026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be created. [ 1034.034436] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.037022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.037022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.037022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.037022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.051747] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1034.332547] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.333738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.333892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.334122] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2634defc-83f9-4615-a509-a5d9c774fed8 with status ACTIVE [ 1034.334337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.334493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.334576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.334840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.334950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.341334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.341515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.341595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.341874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.342025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.342386] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.342481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.342555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.342740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.342834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.342959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2634defc-83f9-4615-a509-a5d9c774fed8 is going to be updated. [ 1034.366417] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.366635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.366635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.366843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.366984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.367162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2634defc-83f9-4615-a509-a5d9c774fed8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.422973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.423182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.423227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.423471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.424609] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.445611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.445905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.446045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.446115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.446326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.446406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.446606] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1034.484945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.485147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.485193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.485393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.485540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495062] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1034.845198] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.926695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.926824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.926901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.927127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.927226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.927332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1034.959713] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.959713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.960022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.960022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.960242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.970379] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1035.351541] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.351541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.351541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.351541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.351541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.351541] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be created. [ 1035.379139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.379416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.379416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.379549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.379715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.390181] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: UNINITIALIZED for 2s [ 1035.743420] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1035.743721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.743901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.744166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.744385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.744509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.744571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.744783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.744899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.745031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.745164] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.072459] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1036.072459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.072459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.072459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.072459] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.250158] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.253027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.253027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.253027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.255518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.255518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.255518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.255518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.255518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.255518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.256012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.256325] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.506332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1036.506578] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe deletion is rescheduled due to dependency. [ 1036.506629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.506787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.507175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.507380] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.507494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.507557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.507718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.507796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.507882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.508052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-0447a165-64dd-4bdf-b4e3-0798d8b91abe taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.508144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.508199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.508325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.508460] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.508586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.508660] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.508742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.508814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.508893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.508981] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.509860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.510064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.510218] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.510318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.510382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.510522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.510597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.510684] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.575026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.575175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.760366] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 1036.779596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.779596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.779596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.779596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.780471] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.780693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.780881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.781170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.781348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.781543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1036.848432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.848432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.848432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.854267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.854267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.869948] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1036.991365] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1036.991597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.991819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.992047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.992254] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.992413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.992461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.992740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.992740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.992907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.992907] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.013657] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0447a165-64dd-4bdf-b4e3-0798d8b91abe: rpc.has_security_group_logging(os_id): False [ 1037.017282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.017282] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.017282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.019662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.019662] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1037.037026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.037026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.037026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.037026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.037915] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.037915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.037915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.037915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.037915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.037915] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be updated. [ 1037.051420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.051420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.051420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.051420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.051420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.061263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1037.107680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.107868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.107868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.108105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.108262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.123671] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: IN_PROGRESS for 2s [ 1037.158898] env[69350]: INFO networking_nsxv3.common.synchronization [None req-bf1ffbb0-a3cd-432a-9f82-7d13eff8f34c tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1037.159464] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1037.159770] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.159895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.159961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.160347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.160438] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.254121] env[69350]: INFO networking_nsxv3.common.synchronization [None req-606d326f-7a52-4459-a8c2-bd1ee4436d15 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1037.254795] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1037.259034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.259400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.399669] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1037.400606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.400606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.400606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.400606] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.400606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.400869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.400869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.400869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.400955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.401034] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.500994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.500994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.500994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.501225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.501602] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.501602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.501602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.501602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.501846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.501846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.501918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.501984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.504204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.504488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.504689] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.504813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.504929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.505067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.505173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.505314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.505401] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.684463] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.684463] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 already deleted. [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.684463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.684463] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.904300] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.010596] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c926423-569b-4b98-81ac-723b20e82ff8: rpc.has_security_group_logging(os_id): False [ 1038.037666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.037873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.037937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.038187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.038338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.038554] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.038658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.038723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.038881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.038955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.039252] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.039365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.039467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.039620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.039745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.040025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.040412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.042443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.042593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.042828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.042862] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1038.106560] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.106711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.106753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.108970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.108970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.133707] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1038.225511] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.226106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.226106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.226720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.226720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.226720] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 already deleted. [ 1038.226852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.405916] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baf89025-1b14-46a4-b655-853662f51662: rpc.has_security_group_logging(os_id): False [ 1038.427140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.427320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.427360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.427600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.427692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.427962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.428081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.428141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.428319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.428414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.428502] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be created. [ 1038.496621] env[69350]: INFO networking_nsxv3.common.synchronization [req-e8c6d99e-6f5c-4bb6-a815-a9bab61a7832 req-78b1dbff-66bb-44a7-8b33-92f7eec944c0 tempest-ImagesOneServerTestJSON-442764698 tempest-ImagesOneServerTestJSON-442764698-project-member] Enqueued Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1038.497650] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1038.501153] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.501153] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.501153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.501153] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.506275] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.506477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.506575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.508720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.508720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.531439] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1038.885794] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1038.886495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.013161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.013645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.013645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.013894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.014039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.014337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.014482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.014697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.014936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.015564] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.015695] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 already deleted. [ 1039.015803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.080204] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1039.080417] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe deletion is rescheduled due to dependency. [ 1039.080535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.096142] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.096724] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-417" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.097025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-417" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.097768] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-417" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.098428] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.100810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.100810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.100810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.100810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.100810] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.100810] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.100810] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.100810] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.100810] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.100810] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.100810] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.143716] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.144759] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.144759] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.144759] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-417" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.146177] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.146177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.146177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.146177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.146177] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b141ed5-6fd5-415b-a11f-ef04f9a32a46',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.147995] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe in Status: SUCCESS [ 1039.148243] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.148522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.148927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.148927] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0447a165-64dd-4bdf-b4e3-0798d8b91abe',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.651602] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.651950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.652140] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.652577] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.652812] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.652996] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 not found, creating... [ 1039.653316] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.653547] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.653722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.658029] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.658029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.658029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 is going to be created. [ 1039.681630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.681919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.681919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.682092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.682186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.682300] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0447a165-64dd-4bdf-b4e3-0798d8b91abe is going to be deleted. [ 1039.685489] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.685827] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.685973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.686331] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.686989] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.687401] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.778358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.778585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.778585] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.778792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.778894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.779012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0447a165-64dd-4bdf-b4e3-0798d8b91abe" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.150129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1040.150435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.150572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.150874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.150981] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.544553] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1040.545225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.560059] env[69350]: INFO networking_nsxv3.common.synchronization [req-e8c6d99e-6f5c-4bb6-a815-a9bab61a7832 req-0594623c-d96f-46ab-bc2b-05f18157af02 service nova] Enqueued Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_rules [ 1040.560059] env[69350]: INFO networking_nsxv3.common.synchronization [req-e8c6d99e-6f5c-4bb6-a815-a9bab61a7832 req-0594623c-d96f-46ab-bc2b-05f18157af02 service nova] Enqueued Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1040.560272] env[69350]: INFO networking_nsxv3.common.synchronization [req-e8c6d99e-6f5c-4bb6-a815-a9bab61a7832 req-0594623c-d96f-46ab-bc2b-05f18157af02 service nova] Enqueued Resource ID: 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 with Priority: HIGHEST for action port [ 1040.564203] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_rules [ 1040.564387] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1040.564482] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 with Priority: HIGHEST for action port [ 1040.565166] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.565309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.565417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.565697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.565816] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.566780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.566856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.566932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.567783] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.568032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.568171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.568278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.568502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.568628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.568730] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.570278] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.570390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.570471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.570674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.570768] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b141ed5-6fd5-415b-a11f-ef04f9a32a46',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.653923] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.654185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.654185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.654624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.654624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.654899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.654899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.655023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.655262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.655262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.655380] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.976588] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d804ea3-7b1c-44a1-a6e9-e0e660271b84 req-7cff45f8-efc5-47cc-9435-f4bfbc556d86 tempest-ServerExternalEventsTest-1560483371 tempest-ServerExternalEventsTest-1560483371-project-member] Enqueued Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1040.977260] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1040.979761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.980139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.980270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.980565] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.980771] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.980887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.980943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.981131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.981218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.981311] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.073114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.074161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.074278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.074657] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 with status ACTIVE [ 1041.074950] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.076563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.076563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.076826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.077175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.078920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.078920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.078920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.078920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b141ed5-6fd5-415b-a11f-ef04f9a32a46 is going to be updated. [ 1041.104664] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.104868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.104918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.105147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.105337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.105543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b141ed5-6fd5-415b-a11f-ef04f9a32a46" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.159128] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.159128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.159128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.159128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.159128] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.159659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.159659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.159659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.159659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.159659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.159906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.159906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.159906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.160026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.163037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.163037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.163037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.163037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.163037] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.399312] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.399312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.399312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.399312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.399312] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.399312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.399312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.400087] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.400424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.400779] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.401056] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.401284] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.401503] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.401743] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.401960] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.402223] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.425969] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.426217] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.426362] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.426545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-36" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.427036] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-64a7521d-80f3-4925-9634-4d3025e8c252 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.427242] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.427368] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.427733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.427876] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64a7521d-80f3-4925-9634-4d3025e8c252',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.460689] env[69350]: INFO networking_nsxv3.common.synchronization [None req-e16ed1a5-3006-4a8f-b1a9-83f79406b020 None None] Enqueued Resource ID: e471561f-4262-4866-b042-84005ee03cad with Priority: HIGHEST for action port [ 1041.461450] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e471561f-4262-4866-b042-84005ee03cad with Priority: HIGHEST for action port [ 1041.461845] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e471561f-4262-4866-b042-84005ee03cad taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.461982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e471561f-4262-4866-b042-84005ee03cad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.462533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e471561f-4262-4866-b042-84005ee03cad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.462806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e471561f-4262-4866-b042-84005ee03cad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.462889] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e471561f-4262-4866-b042-84005ee03cad',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.484784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.484998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.485149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.485436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.485571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.485860] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.485995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.486090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.486299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.486403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.486519] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 already deleted. [ 1041.486621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.579200] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.665405] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c926423-569b-4b98-81ac-723b20e82ff8: rpc.has_security_group_logging(os_id): False [ 1041.684725] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.684900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.684990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.685269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.686180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.686180] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.686180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.686180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.686180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.686180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.686432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.686432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.686507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.686599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.686669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.686863] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.686963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.687331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.687411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.687505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.687618] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1041.751039] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.751221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.751334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.751497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.751648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.768898] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1041.851621] env[69350]: INFO networking_nsxv3.common.synchronization [req-61c86b65-a175-4a7b-8d13-7e4400e6de3f req-dedda983-da35-42b7-bdc6-b384ac1b3b69 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1041.852215] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1041.852650] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.852806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.852875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.853176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.853435] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.853556] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.853630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.853969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.854070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.854169] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.930159] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.930414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.930591] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.930889] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.931107] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.931233] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 64a7521d-80f3-4925-9634-4d3025e8c252 not found, creating... [ 1041.931519] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.931722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.931858] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.932126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.932269] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.932672] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.932833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.932956] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.936850] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.937089] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.937257] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 64a7521d-80f3-4925-9634-4d3025e8c252 is going to be created. [ 1041.962438] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.962677] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.962809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.963102] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.963352] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.963798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.965933] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e471561f-4262-4866-b042-84005ee03cad [ 1041.965933] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.966144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.966144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.966360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.966360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.966456] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e471561f-4262-4866-b042-84005ee03cad already deleted. [ 1041.966456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e471561f-4262-4866-b042-84005ee03cad" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.081928] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.082171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.082247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.082548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.082713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.083331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 is going to be created. [ 1042.120078] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.120271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.120492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.120738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.120927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.136924] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: UNINITIALIZED for 2s [ 1042.359095] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.359095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.359095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.359510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.380254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.380565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.380691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.380762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.381028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.381078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.381178] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1042.408220] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.408400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.408441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.408630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.412020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.418937] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1042.777119] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d804ea3-7b1c-44a1-a6e9-e0e660271b84 req-dba7c190-159f-4583-bfe5-15e2c18f3349 service nova] Enqueued Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_rules [ 1042.777119] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d804ea3-7b1c-44a1-a6e9-e0e660271b84 req-dba7c190-159f-4583-bfe5-15e2c18f3349 service nova] Enqueued Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1042.777333] env[69350]: INFO networking_nsxv3.common.synchronization [req-3d804ea3-7b1c-44a1-a6e9-e0e660271b84 req-dba7c190-159f-4583-bfe5-15e2c18f3349 service nova] Enqueued Resource ID: 64a7521d-80f3-4925-9634-4d3025e8c252 with Priority: HIGHEST for action port [ 1042.777518] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_rules [ 1042.777672] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1042.777789] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64a7521d-80f3-4925-9634-4d3025e8c252 with Priority: HIGHEST for action port [ 1042.778407] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.779736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.779736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.779736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.779736] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.779890] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.780043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.780168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.780428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.780510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.780656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.780737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.780904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.781016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.781124] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.783581] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-64a7521d-80f3-4925-9634-4d3025e8c252 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.783705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.783747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.784413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.784413] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64a7521d-80f3-4925-9634-4d3025e8c252',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.286236] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.287324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.287429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.288245] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64a7521d-80f3-4925-9634-4d3025e8c252 with status ACTIVE [ 1043.288245] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.288245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.288245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.288389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.288389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.288780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.288780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.288780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.289315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.289407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.289706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.289706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.289876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.289925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.289973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.290038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64a7521d-80f3-4925-9634-4d3025e8c252 is going to be updated. [ 1043.311665] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.311892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.311892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.312085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.312224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.312408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64a7521d-80f3-4925-9634-4d3025e8c252" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.785906] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1043.786155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.788590] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.896506] env[69350]: INFO networking_nsxv3.common.synchronization [req-6bf065a7-7a4d-48e9-be4a-438059cbc269 req-9944de18-590f-472b-8b34-ffcb4533ce6f tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1043.896645] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1043.896947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.898177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.898275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.898577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.898780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.898935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.899045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.899292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.899439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.900764] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.148170] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: SUCCESS [ 1044.148393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.148562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.148780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.148970] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.149097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.149163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.149314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.153137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.153346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.153479] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.291024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.291259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.291354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.291631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.291763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.291871] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 is going to be created. [ 1044.317753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.318034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.318034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.318280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.318445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.330130] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: UNINITIALIZED for 2s [ 1044.402228] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.402460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.402570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.402800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.402929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.403173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.403310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.403369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.403568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.403684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.403796] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 already deleted. [ 1044.403884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.428606] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1044.428833] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1044.428969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.656262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.657053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.657053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.659802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.659802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.659802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.659802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.659802] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.843022] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.843022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.843022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.843022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.844256] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.844256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.844256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.844526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.844624] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.844921] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.845107] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.845282] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.845453] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.845624] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.845775] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.846047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.869717] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.869911] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.870078] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.870298] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.870633] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-49accdd2-d40d-4ad8-bbe1-5d094943074a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.870813] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.870936] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.871305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.871452] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49accdd2-d40d-4ad8-bbe1-5d094943074a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.162159] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75eb547d-6979-4aec-96c8-0d45c4db4c73: rpc.has_security_group_logging(os_id): False [ 1045.199769] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.199769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.200291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.200291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.200291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.200535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.200535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.200535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.200825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.200825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.200965] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.201118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.201118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.201291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.201291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.201461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.201548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.201624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.201838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.201944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.202039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 is going to be created. [ 1045.272713] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.272889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.272957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.274733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.274733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.287637] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: IN_PROGRESS for 2s [ 1045.375174] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.375396] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.375504] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.375886] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.376072] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.376278] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 49accdd2-d40d-4ad8-bbe1-5d094943074a not found, creating... [ 1045.376663] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.376771] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.376897] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.377155] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.377333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.377641] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.377805] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.377927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.378165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.378328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.378480] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 49accdd2-d40d-4ad8-bbe1-5d094943074a is going to be created. [ 1045.413315] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.413578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.413722] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.414065] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.414340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.414577] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.874477] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ab142cc-bf3b-43a8-ab44-9c0bd7181f0c req-dbf113da-629b-43f3-84d4-a9cbcc0aa486 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1045.874996] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1045.875446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.875575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.875639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.875834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.875985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.876097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.876157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.876307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.876392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.876488] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.081871] env[69350]: INFO networking_nsxv3.common.synchronization [req-c51b8cab-b185-4dea-871d-0ec42bea6bb7 req-d3ba6f58-2743-4e14-9a40-dadc6707ea2c tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1046.082488] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1046.082812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.082935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.082994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.083249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.083399] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.083513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.083576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.083722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.083805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.083895] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.094541] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ab142cc-bf3b-43a8-ab44-9c0bd7181f0c req-b2350fcc-f443-4946-a66f-adc2f836b9eb tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1046.094541] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1046.094784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.094861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.343980] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: SUCCESS [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.343980] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.343980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.343980] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.355882] env[69350]: INFO networking_nsxv3.common.synchronization [req-2bc0421e-45a9-4ec5-8490-6da96d5b02c0 req-8e14a2ec-9cb2-4ac5-b7a2-2e6086af8461 tempest-ServerActionsV293TestJSON-1388554867 tempest-ServerActionsV293TestJSON-1388554867-project-member] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1046.355882] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1046.355882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.355882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.355882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.355882] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.380603] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.423313] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ab142cc-bf3b-43a8-ab44-9c0bd7181f0c req-ca73ce2c-cf76-4ef0-9171-010dc967af73 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1046.423313] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1046.423313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.423552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [req-6bf065a7-7a4d-48e9-be4a-438059cbc269 req-c6ba2828-e424-4db4-8490-fad410367b93 service nova] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [req-6bf065a7-7a4d-48e9-be4a-438059cbc269 req-c6ba2828-e424-4db4-8490-fad410367b93 service nova] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [req-6bf065a7-7a4d-48e9-be4a-438059cbc269 req-c6ba2828-e424-4db4-8490-fad410367b93 service nova] Enqueued Resource ID: 49accdd2-d40d-4ad8-bbe1-5d094943074a with Priority: HIGHEST for action port [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1046.525016] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49accdd2-d40d-4ad8-bbe1-5d094943074a with Priority: HIGHEST for action port [ 1046.525016] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.525358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.525358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.525433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.525551] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.526297] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.526415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.526479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.526693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.526849] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.526945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.527016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.527166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.527248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.527334] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.528109] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-49accdd2-d40d-4ad8-bbe1-5d094943074a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.528176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.528220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.528369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.528437] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49accdd2-d40d-4ad8-bbe1-5d094943074a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.589160] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.589160] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.589160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.589160] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1046.617185] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.617185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.617185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.617185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.617185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.624393] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1046.750020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.750020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-308" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.750020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-308" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.750020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-308" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.750020] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.750020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.750020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.750620] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.751088] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.751410] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.751696] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.751940] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.752172] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.752446] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.752674] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.752908] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.773273] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.776018] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.776018] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.776018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-308" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.776018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c33ee153-839a-41ed-94a2-f5c98d3fb342 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.776018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.776018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.776018] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.776018] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33ee153-839a-41ed-94a2-f5c98d3fb342',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.852025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.852025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.852025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.852025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.852025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.852854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.852854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.852854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.852854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.852854] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.859466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.859466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.859466] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b already deleted. [ 1046.859466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.882022] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.033024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.033024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49accdd2-d40d-4ad8-bbe1-5d094943074a with status ACTIVE [ 1047.033024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.033024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.033024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.033855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.033855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.033855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.033855] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49accdd2-d40d-4ad8-bbe1-5d094943074a is going to be updated. [ 1047.055335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.055335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.055335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.055335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.055335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.055335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49accdd2-d40d-4ad8-bbe1-5d094943074a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.281022] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.281022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c33ee153-839a-41ed-94a2-f5c98d3fb342 not found, creating... [ 1047.281022] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.281022] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.282069] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.282462] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.282713] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.283059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.283387] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.283693] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c33ee153-839a-41ed-94a2-f5c98d3fb342 is going to be created. [ 1047.305271] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: SUCCESS [ 1047.305271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.308867] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.308867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.308867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.308867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.308867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.308867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.355837] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7176c448-4084-4ddf-b065-53b7560b7c98: rpc.has_security_group_logging(os_id): False [ 1047.373941] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.373941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.373941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.373941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.373941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.373941] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.374584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.374584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.374584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.374584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.374584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.374903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.374903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.374903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.375033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.375200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.375279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.375346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.375511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.375571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.375685] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 is going to be created. [ 1047.383947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.384140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.384186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.384397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.384490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.384605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1047.455140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.455343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.455436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.456053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.456053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.466672] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1047.477893] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.478101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.478101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.478322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.478575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.499925] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: IN_PROGRESS for 2s [ 1047.531770] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.034345] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.034678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.034678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.034830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.034931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.035051] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be created. [ 1048.062173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.062326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.062582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.062902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.063187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.074382] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: UNINITIALIZED for 2s [ 1048.078386] env[69350]: INFO networking_nsxv3.common.synchronization [req-2bc0421e-45a9-4ec5-8490-6da96d5b02c0 req-feb69870-6561-4893-ab00-85fda44366e3 service nova] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 1048.078575] env[69350]: INFO networking_nsxv3.common.synchronization [req-2bc0421e-45a9-4ec5-8490-6da96d5b02c0 req-feb69870-6561-4893-ab00-85fda44366e3 service nova] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1048.078716] env[69350]: INFO networking_nsxv3.common.synchronization [req-2bc0421e-45a9-4ec5-8490-6da96d5b02c0 req-feb69870-6561-4893-ab00-85fda44366e3 service nova] Enqueued Resource ID: c33ee153-839a-41ed-94a2-f5c98d3fb342 with Priority: HIGHEST for action port [ 1048.079037] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_rules [ 1048.079174] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1048.079270] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33ee153-839a-41ed-94a2-f5c98d3fb342 with Priority: HIGHEST for action port [ 1048.079903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.080029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.080029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.080830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.080973] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.082571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.082774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.082880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.083140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.083351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.083523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.083649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.083849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.083980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.084612] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.085219] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33ee153-839a-41ed-94a2-f5c98d3fb342 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.085219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.085379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.085539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.085655] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33ee153-839a-41ed-94a2-f5c98d3fb342',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.587718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.587900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.588133] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.589043] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c33ee153-839a-41ed-94a2-f5c98d3fb342 with status ACTIVE [ 1048.589228] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.589344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.589411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.589626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.589718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.590296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.590464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.590537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.590720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.590764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.590974] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.591086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.591149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.591303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.591377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.591463] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c33ee153-839a-41ed-94a2-f5c98d3fb342 is going to be updated. [ 1048.616433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.616641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.616641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.617200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.617341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.617497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33ee153-839a-41ed-94a2-f5c98d3fb342" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.634445] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1048.634445] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1048.634445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.097254] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.479581] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1049.479880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.480077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.480307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.480900] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.480900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.480900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.481078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.481078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.481139] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.512890] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: SUCCESS [ 1049.513130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.599116] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.599278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.599426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.599634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.599727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.600699] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b is going to be created. [ 1049.626651] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.626812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.626886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.627145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.627328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.640353] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: UNINITIALIZED for 2s [ 1049.985049] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.985049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.985049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.985049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.985049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.985496] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.985496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.985496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.985680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.985680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.985779] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1050.019267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.019474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.019474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.019718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.019877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.048186] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1050.088081] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1050.088081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.088081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.088510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.088510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.088639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.088699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.088876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.088989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.089176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.089442] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.592510] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.097432] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e026144d-94fe-4b76-82b5-8dd361aa66d8: rpc.has_security_group_logging(os_id): False [ 1051.118863] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.119112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.119112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.119417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.119417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.119624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.119742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.119810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.119927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.119989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.120095] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be created. [ 1051.315761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.315981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.317034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.317034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.317034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.344120] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1051.663576] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: SUCCESS [ 1051.663576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.663576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.663576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.664153] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.664153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.664153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.664270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.664270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.664361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.664455] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.713807] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ba923df-f58a-473a-adf9-26835c8433d6 req-6436e7ed-8001-40d1-905c-34ace2ea3caf tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1051.714914] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1051.715192] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.715349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.715426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.717204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.717204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.717377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.717440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.717655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.717760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.717883] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.063026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1052.063026] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 deletion is rescheduled due to dependency. [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.063026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.063026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.063026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.085576] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.085830] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.085935] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.086303] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.086736] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.086736] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.086930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.087110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.087303] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.087502] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.087634] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.087946] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.087946] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.088026] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.088131] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.088308] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.111793] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.111993] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.112163] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.112345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.112795] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-b88a111b-0287-40ab-8275-2607f2bf20c2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.113680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.113680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.113680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.113680] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b88a111b-0287-40ab-8275-2607f2bf20c2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.167774] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.220399] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.567512] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.567714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.567832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.568069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.568191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.568430] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.568528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.568592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.568758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.568839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.568931] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1052.612714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.616712] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.616712] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.617111] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.617111] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port b88a111b-0287-40ab-8275-2607f2bf20c2 not found, creating... [ 1052.617263] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.617419] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.620631] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.620631] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.620631] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: b88a111b-0287-40ab-8275-2607f2bf20c2 is going to be created. [ 1052.627324] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1052.646287] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.646516] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.646642] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.646967] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.647208] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647440] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.670605] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce5d9ba7-7740-404a-9bcb-b276b50dbc4b: rpc.has_security_group_logging(os_id): False [ 1052.692961] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.693152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.693224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.693491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.693600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.696107] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.696107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.696107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.696107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.696107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.696107] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b is going to be created. [ 1052.723816] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.813725] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.813725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.813725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.814018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.814018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.828173] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: IN_PROGRESS for 2s [ 1053.227127] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.227468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.227468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.227919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.227919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.227919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1053.271989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.272246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.272560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.272708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.272998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.284647] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1053.360151] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1053.360151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ba923df-f58a-473a-adf9-26835c8433d6 req-51fdc6f1-b67e-4ca7-ba52-78cde024d628 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ba923df-f58a-473a-adf9-26835c8433d6 req-51fdc6f1-b67e-4ca7-ba52-78cde024d628 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [req-6ba923df-f58a-473a-adf9-26835c8433d6 req-51fdc6f1-b67e-4ca7-ba52-78cde024d628 service nova] Enqueued Resource ID: b88a111b-0287-40ab-8275-2607f2bf20c2 with Priority: HIGHEST for action port [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1053.723481] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88a111b-0287-40ab-8275-2607f2bf20c2 with Priority: HIGHEST for action port [ 1053.724796] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.725075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.725183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.725503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.726232] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.726958] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.727099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.727513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b88a111b-0287-40ab-8275-2607f2bf20c2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.727612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.727711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.727872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.727922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b88a111b-0287-40ab-8275-2607f2bf20c2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.233029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.233029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b88a111b-0287-40ab-8275-2607f2bf20c2 with status ACTIVE [ 1054.233029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.233029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.233029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.233029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.233917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.233917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.233917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.233917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.233917] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b88a111b-0287-40ab-8275-2607f2bf20c2 is going to be updated. [ 1054.259364] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.261286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.261286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.261286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.261286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.261286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b88a111b-0287-40ab-8275-2607f2bf20c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.640024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1054.640024] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 deletion is rescheduled due to dependency. [ 1054.640024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.847803] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: SUCCESS [ 1054.847803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.866513] env[69350]: INFO networking_nsxv3.common.synchronization [req-d45376b0-8721-4e0d-ac2d-7a5634a5d5fc req-b38be482-476e-4ec6-a3a8-1a0ae60e1f87 tempest-ServerExternalEventsTest-1560483371 tempest-ServerExternalEventsTest-1560483371-project-member] Enqueued Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1054.867244] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGHEST for action security_group_members [ 1054.867615] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.867750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.867802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.868403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.868403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.868403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.868403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.869467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.869467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.869467] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.296371] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1055.296756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.297057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.297388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.297693] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.297913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.298056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.298324] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.298478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.298672] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.371518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.371847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.371847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.372124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.372225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.372451] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.372584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.372718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.372949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.373090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.373263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 is going to be updated. [ 1055.407381] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.407604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.407716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.409043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.409043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.420749] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: IN_PROGRESS for 2s [ 1055.803114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.306970] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.811979] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.812347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.812347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.812742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.812950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.813080] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1056.850819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.851039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.851039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.866318] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1057.432956] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176c448-4084-4ddf-b065-53b7560b7c98 in Status: SUCCESS [ 1057.432956] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 deletion is rescheduled due to dependency. [ 1057.432956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.877231] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1058.877480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.878662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.878662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.878662] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.878662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.878662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.878662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.879150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.879150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.879150] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.381995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.382185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.382293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.382743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.382867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.382998] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.383099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.383276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.383365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.383454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.383614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.383710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.383772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.383990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.384183] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.384333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.384434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.384610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.384692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.384775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.384867] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.868369] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1059.868541] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1059.893038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 1059.913708] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.913708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.913885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.914036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.936351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.936646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.936769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.936837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.937054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.937137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.937333] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.937428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.937493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.937640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.937718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.937897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.938029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.938074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.938198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.938272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.938360] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1059.998602] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.998602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.999033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.999033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.999226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.017523] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1062.043846] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1062.043846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.808727] env[69350]: INFO networking_nsxv3.common.synchronization [req-715292e0-c2ff-478a-a4f6-cbb94c8ffdfc req-76eebe34-8c2e-42cc-a911-62d2feda9e8e tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1062.809297] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1062.809931] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.810118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.810233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.810679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.811048] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.811338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.811530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.811814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.812077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.812328] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.315206] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.315560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.315560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.315676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.315806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.315962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.316075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.316307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.316307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.316446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.316446] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 already deleted. [ 1063.316516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.324277] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.324480] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.324609] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.324912] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.329156] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.329156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.329156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.329156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.329156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.329156] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.329156] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.329156] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.329156] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.329156] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.329156] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.329156] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.349649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.349828] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.349972] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.350185] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.350567] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-8a81efc1-212c-4294-8a2d-f9f77427eb12 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.350792] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.350931] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.351298] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.351489] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a81efc1-212c-4294-8a2d-f9f77427eb12',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.854382] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.854708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.854894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.855266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.855469] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.855640] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 8a81efc1-212c-4294-8a2d-f9f77427eb12 not found, creating... [ 1063.856018] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.856202] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.856375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.856663] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.856831] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.857209] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.857437] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.857613] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.857921] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.858294] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.858345] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 8a81efc1-212c-4294-8a2d-f9f77427eb12 is going to be created. [ 1063.883119] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.883399] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.883532] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.883885] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.884155] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.884394] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.740306] env[69350]: INFO networking_nsxv3.common.synchronization [req-715292e0-c2ff-478a-a4f6-cbb94c8ffdfc req-39b40d7c-ca87-4aa3-9c06-066706a93ee9 service nova] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1064.740306] env[69350]: INFO networking_nsxv3.common.synchronization [req-715292e0-c2ff-478a-a4f6-cbb94c8ffdfc req-39b40d7c-ca87-4aa3-9c06-066706a93ee9 service nova] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1064.740306] env[69350]: INFO networking_nsxv3.common.synchronization [req-715292e0-c2ff-478a-a4f6-cbb94c8ffdfc req-39b40d7c-ca87-4aa3-9c06-066706a93ee9 service nova] Enqueued Resource ID: 8a81efc1-212c-4294-8a2d-f9f77427eb12 with Priority: HIGHEST for action port [ 1064.740868] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_rules [ 1064.740868] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1064.740868] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a81efc1-212c-4294-8a2d-f9f77427eb12 with Priority: HIGHEST for action port [ 1064.741698] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.741821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.741907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.742143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.742306] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.746505] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.746658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.746737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.746970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.747197] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.747423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.747423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.747560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.747642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.747746] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.752584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a81efc1-212c-4294-8a2d-f9f77427eb12 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.752819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.752819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.753095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.753154] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a81efc1-212c-4294-8a2d-f9f77427eb12',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.255471] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.255471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.256826] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.259033] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a81efc1-212c-4294-8a2d-f9f77427eb12 with status ACTIVE [ 1065.259033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.259033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.264510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.264510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.264510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.265054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.265054] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a81efc1-212c-4294-8a2d-f9f77427eb12 is going to be updated. [ 1065.290373] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.290546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.290843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.291108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.291307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.291512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a81efc1-212c-4294-8a2d-f9f77427eb12" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.490194] env[69350]: INFO networking_nsxv3.common.synchronization [req-2886ab54-6d90-41e4-8fab-e5ee996b00e2 req-8594beb4-a1de-47cc-8c01-d4374bc1808a tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1065.491271] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1065.491613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.491741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.491824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.492065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.492229] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.492333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.492469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.492547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.492715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.492796] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.516641] env[69350]: INFO networking_nsxv3.common.synchronization [req-745ce98b-4bef-4330-a880-8ab79f530fc0 req-28f541a8-cda9-46ad-895a-1eaa015d762d tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1065.517198] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1065.517510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.517635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.517724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.517929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.518135] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.518241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.518305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.518476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.518586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.518686] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.767033] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.997914] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.020695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.020891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.020963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.021216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.021317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.021542] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.021632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.021694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.021895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.021932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.021998] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1066.055288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.055288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.055288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.055288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.055288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.067473] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1066.269280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.269569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.269694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.269971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.270095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.270204] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 is going to be created. [ 1066.295983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.296220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.296220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.296442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.296605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.308191] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: UNINITIALIZED for 2s [ 1066.499795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.675263] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.676079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.676079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.676079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.676656] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.676656] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.676656] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.676913] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.677026] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.677302] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.677424] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.677551] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.677667] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.677782] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.677920] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.678076] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.701117] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.701117] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.701117] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.701314] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.701543] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-ea5c5a37-3810-4444-b5d0-494b3f8137f8 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.702897] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.702897] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.702897] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.702897] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea5c5a37-3810-4444-b5d0-494b3f8137f8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.002111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.002441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.002441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.002638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.002739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.002845] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1067.030104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.031276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.040693] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1067.208807] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.209164] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.209273] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.209485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.209637] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.209828] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port ea5c5a37-3810-4444-b5d0-494b3f8137f8 not found, creating... [ 1067.210586] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.210791] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.210926] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.211234] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.211367] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.211699] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.211883] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.212029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.213721] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.213947] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.214231] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: ea5c5a37-3810-4444-b5d0-494b3f8137f8 is going to be created. [ 1067.273663] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.273911] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.274021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.274319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.274638] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.274861] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.081152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1068.081381] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1068.081479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.104367] env[69350]: INFO networking_nsxv3.common.synchronization [req-745ce98b-4bef-4330-a880-8ab79f530fc0 req-986c986d-97b8-47c5-9619-a813fb5a2be9 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1068.104557] env[69350]: INFO networking_nsxv3.common.synchronization [req-745ce98b-4bef-4330-a880-8ab79f530fc0 req-986c986d-97b8-47c5-9619-a813fb5a2be9 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1068.104702] env[69350]: INFO networking_nsxv3.common.synchronization [req-745ce98b-4bef-4330-a880-8ab79f530fc0 req-986c986d-97b8-47c5-9619-a813fb5a2be9 service nova] Enqueued Resource ID: ea5c5a37-3810-4444-b5d0-494b3f8137f8 with Priority: HIGHEST for action port [ 1068.104933] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1068.105347] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1068.105347] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c5a37-3810-4444-b5d0-494b3f8137f8 with Priority: HIGHEST for action port [ 1068.105741] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.105865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.105980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.106292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.106379] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.107753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.108007] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.108088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.108285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.108473] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.108587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.108643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.108797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.108877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.108971] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.110580] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea5c5a37-3810-4444-b5d0-494b3f8137f8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.110699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.110769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.111052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.111135] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea5c5a37-3810-4444-b5d0-494b3f8137f8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.243416] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-543 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.243725] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.244330] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.244330] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.244472] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.244661] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.244789] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.245043] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.245762] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.245762] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.245762] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.245762] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.245940] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.245940] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.246062] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.246212] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.264943] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.265243] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.265385] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.265561] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-543" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.265884] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-7a79c52a-a307-43ac-bcb4-c636de094b1a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.266068] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.266190] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.266461] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.266606] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a79c52a-a307-43ac-bcb4-c636de094b1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.321311] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: SUCCESS [ 1068.321491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.322122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.322122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.322122] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.322539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.322539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.322539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.322799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.322799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.322799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.608768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.608768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.611783] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.612455] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea5c5a37-3810-4444-b5d0-494b3f8137f8 with status ACTIVE [ 1068.612863] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.613170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.613235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.613394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.613494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.614260] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.614260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.614260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.614475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.614475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.614767] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.614767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.615203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.615203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.615203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.615203] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea5c5a37-3810-4444-b5d0-494b3f8137f8 is going to be updated. [ 1068.637931] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.638148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.638148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.638371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.638555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.638934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea5c5a37-3810-4444-b5d0-494b3f8137f8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.768945] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.769131] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.769495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.769767] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.769767] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.770111] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.770363] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.770526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.770867] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.771160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.771495] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.771617] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.771782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.772040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.772224] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.772414] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a is going to be updated. [ 1068.800193] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.800480] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.800616] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.801505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.801866] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.802187] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.825125] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.051835] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1069.052166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.118079] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.328281] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f3cb76-3fba-47b9-bac9-ea6821feb810: rpc.has_security_group_logging(os_id): False [ 1069.351084] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.351084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.351084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.351305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.351340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.351659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.351795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.351985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.352135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.352241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352345] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 is going to be created. [ 1069.414395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.414665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.414665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.414924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.415226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.432294] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: IN_PROGRESS for 2s [ 1069.594042] env[69350]: INFO networking_nsxv3.common.synchronization [req-6e6434fc-e28a-4906-83d7-bef6a9f8a049 req-5a4d8b5b-7b5a-48df-8028-9a12daf5acdb service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 1069.594243] env[69350]: INFO networking_nsxv3.common.synchronization [req-6e6434fc-e28a-4906-83d7-bef6a9f8a049 req-5a4d8b5b-7b5a-48df-8028-9a12daf5acdb service nova] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 1069.594387] env[69350]: INFO networking_nsxv3.common.synchronization [req-6e6434fc-e28a-4906-83d7-bef6a9f8a049 req-5a4d8b5b-7b5a-48df-8028-9a12daf5acdb service nova] Enqueued Resource ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a with Priority: HIGHEST for action port [ 1069.594908] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_rules [ 1069.595092] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 1069.595201] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a with Priority: HIGHEST for action port [ 1069.595478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.595597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.595667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.595863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.595944] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.598277] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.598407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.598477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.598656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.598810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.598908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.598972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.599143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.599267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.599318] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.600054] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a79c52a-a307-43ac-bcb4-c636de094b1a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.600162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.600221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.600374] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.600445] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a79c52a-a307-43ac-bcb4-c636de094b1a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.620526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.620790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.620832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.621063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.621316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621316] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1069.653936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.654179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.654284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.654514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.655712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.666042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1070.102014] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.103262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.103774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.103774] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a79c52a-a307-43ac-bcb4-c636de094b1a with status ACTIVE [ 1070.103909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.103969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.104022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.104330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.104437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.104680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.104830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.104898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.105149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.105253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.105430] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.105530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.105599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.105768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.105855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.105944] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a79c52a-a307-43ac-bcb4-c636de094b1a is going to be updated. [ 1070.128361] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.128662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.128662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.129025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.129025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.129150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a79c52a-a307-43ac-bcb4-c636de094b1a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.215991] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1070.215991] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1070.607768] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.113988] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.113988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.113988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.113988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.113988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.113988] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 1071.147355] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.147355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.148992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.148992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.148992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.157707] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 1071.444721] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: SUCCESS [ 1071.445056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.679530] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1071.679688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.680080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.681012] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.681012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.681534] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.187337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.187337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.187337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.187337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.187337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.188129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.188129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.188129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.188129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.188129] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.693032] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1072.716262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.716262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.716262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.716262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.716779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.716779] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.716779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.716881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.717485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.717485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.717485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1072.786358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.786708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.786708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.786909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.787048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.806061] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1072.987292] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bb33c4c-3c2c-4928-a431-7124328ee1f7 req-2e1efe44-de6c-4b42-8299-009a68efc495 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1072.987439] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1072.987871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.988361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.988498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.989025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.992412] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.992567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.992636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.992903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.993188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.993360] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.168784] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 1073.169028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.169203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.169485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.169677] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.169798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.169864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.170049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.170155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.170256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.171011] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.319285] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.319568] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.319611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.320433] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.320433] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.320433] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.321335] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.322170] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.322336] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.322554] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.322733] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.322881] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.322996] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.323127] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.323237] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.323435] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.347073] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.347443] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1073.347443] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.347588] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.347903] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.348069] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.348193] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.348539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.348799] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd8e2ca-97e4-42db-9c1a-ab1bc9393726',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.497152] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.678996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.678996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.678996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.678996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.678996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.679806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.679806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.679806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.679806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.679806] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.815103] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3da2782e-7f15-45d6-a8d0-ec32f280ddf2 None None] Enqueued Resource ID: 5e7fecc4-6457-4029-86d0-60ca0fca066e with Priority: HIGHEST for action port [ 1073.815798] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7fecc4-6457-4029-86d0-60ca0fca066e with Priority: HIGHEST for action port [ 1073.820315] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e7fecc4-6457-4029-86d0-60ca0fca066e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.820485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e7fecc4-6457-4029-86d0-60ca0fca066e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.820539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e7fecc4-6457-4029-86d0-60ca0fca066e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.820984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e7fecc4-6457-4029-86d0-60ca0fca066e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.820984] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e7fecc4-6457-4029-86d0-60ca0fca066e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.853375] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.853375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.853375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.853375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.853375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.853375] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 not found, creating... [ 1073.853375] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.855507] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.855673] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.856117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.856382] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.856789] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.856991] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.857180] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.857450] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.857700] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.857951] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 is going to be created. [ 1073.884737] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.884981] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.885270] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.885702] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.885962] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.886287] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.000797] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.181679] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac836d8b-740c-4a34-ae58-041041eb8e77: rpc.has_security_group_logging(os_id): False [ 1074.213377] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.213993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.214222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.214624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.242449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.242449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.242449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.243680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.246875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.246875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.246875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.246875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.246875] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 1074.326190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.326190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.326190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.326190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.326190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.326190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e7fecc4-6457-4029-86d0-60ca0fca066e [ 1074.330641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.331070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.331290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.332592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.332592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.332592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e7fecc4-6457-4029-86d0-60ca0fca066e already deleted. [ 1074.332592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e7fecc4-6457-4029-86d0-60ca0fca066e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.360458] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 1074.505126] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.505126] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.505253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.505445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.505538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.505668] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1074.542287] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.542492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.542711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.542767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.542937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.554833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1074.826914] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1074.827795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bb33c4c-3c2c-4928-a431-7124328ee1f7 req-3c83715d-2777-4889-ae5f-e1b33913a819 service nova] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bb33c4c-3c2c-4928-a431-7124328ee1f7 req-3c83715d-2777-4889-ae5f-e1b33913a819 service nova] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bb33c4c-3c2c-4928-a431-7124328ee1f7 req-3c83715d-2777-4889-ae5f-e1b33913a819 service nova] Enqueued Resource ID: 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 with Priority: HIGHEST for action port [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_rules [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1075.058087] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 with Priority: HIGHEST for action port [ 1075.059996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.060358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.062050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.062050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.062050] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.063332] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.064299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.064299] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.064299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.064299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.066018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.066018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd8e2ca-97e4-42db-9c1a-ab1bc9393726',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.569482] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.569482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.571319] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 with status ACTIVE [ 1075.571319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.571319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.571319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.571664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.571664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.572135] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.572135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.572135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.572291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.572291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.572432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.572523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.572601] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.572772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.572843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.572928] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cd8e2ca-97e4-42db-9c1a-ab1bc9393726 is going to be updated. [ 1075.605885] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.606063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.606123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.606345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.606484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.606649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cd8e2ca-97e4-42db-9c1a-ab1bc9393726" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.147955] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.148151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.148225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.148474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.148588] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.164527] env[69350]: INFO networking_nsxv3.common.synchronization [None req-f6d66975-2eb7-401a-bd77-2f324d9bef40 None None] Enqueued Resource ID: f6055aef-308b-4043-8681-16503965895d with Priority: HIGHEST for action port [ 1076.165258] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6055aef-308b-4043-8681-16503965895d with Priority: HIGHEST for action port [ 1076.165595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6055aef-308b-4043-8681-16503965895d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.165711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6055aef-308b-4043-8681-16503965895d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.165752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6055aef-308b-4043-8681-16503965895d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.166011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6055aef-308b-4043-8681-16503965895d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.166114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6055aef-308b-4043-8681-16503965895d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.377599] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 1076.377795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.569187] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.569187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.569187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.569187] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.652351] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.668996] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6055aef-308b-4043-8681-16503965895d [ 1076.669359] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.669568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.669568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.669686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.670258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.670258] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6055aef-308b-4043-8681-16503965895d already deleted. [ 1076.670258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6055aef-308b-4043-8681-16503965895d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.072066] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.159162] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.530667] env[69350]: INFO networking_nsxv3.common.synchronization [req-c99fc5b4-2574-47da-a5a5-f0f1e17c5316 req-b7ea0b0a-4499-4de2-8c0f-900749cd65c9 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1077.531413] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1077.531791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.531927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.532055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.532330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.532525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.532629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.532692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.534508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.534650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.534797] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.574797] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.664422] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1077.664422] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1077.997908] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.998219] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.998360] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.998660] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.999096] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.999210] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.999328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.999578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.000060] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.000348] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.000472] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.000587] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.000833] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.000989] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.001200] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.001418] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.023406] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.023626] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.023891] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.024126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.024726] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.024894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.024894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.025361] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.025552] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.038706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.038892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.038933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.042079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.042079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.042079] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1078.077090] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.077090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.077090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.077304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.077947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.082026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.083558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.083647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.083914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.084048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084169] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1078.107026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1078.132769] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.132769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.132769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.132769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.132769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.147433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1078.528056] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.528415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.528559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.528882] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.529136] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.529307] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c not found, creating... [ 1078.529627] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.529884] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.530040] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.530510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.530510] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.530839] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.531192] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.531341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.531636] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.532238] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.532238] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c is going to be created. [ 1078.562937] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.563247] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.563424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.563788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.564231] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.564964] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.618828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.618828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.618828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.619463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.635678] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1078.636860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.638652] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1078.688961] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.688961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.688961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.688961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.705036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.705859] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1078.705953] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1078.706145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1078.775942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.776327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.776327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.776455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.777725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.777932] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1078.865728] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.866033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.866092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.866340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.866678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.866987] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1078.951316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.951316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.951316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.951555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.951816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.952096] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1078.952224] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'21f3cb76-3fba-47b9-bac9-ea6821feb810', '2e075408-82f5-4e52-84f7-426a04568f7e', '6b54caf5-2187-4343-bc88-b3ec40430d8a', '2ff45cfa-44be-4184-a622-fcee3f7d548c', '08655f30-40a0-4bfa-8418-b72abb59f910', '5a9fd008-a5ab-421a-b65b-4aa0354d7aef', 'e0eab42b-aa65-450c-a7c9-ef9dfeea65c1', '30d7c80b-0893-40cf-bbe9-c943f87b4d3e', 'cc3154b0-663b-480d-966a-1fbdbe6d7897', 'fd9e37a4-5f26-4f1d-91f1-8a66db647d9f', '49b616ed-5cd5-4814-a54b-e879de71d218', 'ac836d8b-740c-4a34-ae58-041041eb8e77', '5da239e8-9db8-4bbe-8e09-d7f855a6ffb7', 'bdbb2071-5801-4662-9a75-aa174ebd2139', '3373549f-c839-4d1c-a55a-af37a3148994', '7176c448-4084-4ddf-b065-53b7560b7c98', 'e026144d-94fe-4b76-82b5-8dd361aa66d8', '2f159146-6707-4314-98f2-9023803a47fc', '01249833-e649-48c7-b9c6-9d9107bdff51', '63a393ca-d0ba-4ee5-9055-2295ecf1b143', '935f66d0-48ab-44a6-9d44-d9c84d53af88', '9d3a437f-2228-4b2f-acaf-32ef289c6c55', 'ce437c5a-9850-4106-9109-1794494f0682', 'c424677c-a7b4-455f-b6cc-392100496fd8', '75eb547d-6979-4aec-96c8-0d45c4db4c73', 'baf89025-1b14-46a4-b655-853662f51662', '9afc4840-93eb-4fb0-b332-e1e98651f1ec', '30f3c1b0-c88c-48f8-a076-d6df7cdbf573', 'ffa8eacd-d072-4180-a46b-fc0e52002a8b', '4938dad0-1aaa-448e-8a86-4203e6ccd867', 'e27c7362-80ef-4c99-9dd6-75361259db7f', '7c5d6740-3439-4769-8b56-9e97215cbf77', '0fd7257c-afd4-47d6-ae01-960d2d62dba1', '0ab8bb33-410e-45b2-83bb-f1219bc73c45', '8c926423-569b-4b98-81ac-723b20e82ff8', '518254d1-d440-4d15-b32d-8975c834377a', 'e42630d9-6f58-45c4-a768-a81a12bdfa43', 'a07d8013-92b1-46a1-acb2-34b3df1ac235', 'f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f', 'f77ff482-c36b-41a0-9c84-caa4cc51cf3d', '8bcf01dc-147d-49bc-839a-137d73c85e2d', '250212f8-b7b8-4a59-919a-a1ed1d003c9a', 'f9657ac2-98f3-4bb3-988b-9e7555afd46b', 'ce5d9ba7-7740-404a-9bcb-b276b50dbc4b', 'b7d6c991-1741-482f-bd6f-0a1e7794c335'} {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1078.952343] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1078.975757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.976039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.976039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.976213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.976380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.976443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1078.976507] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1078.976570] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1079.113214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.113393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.113463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.113688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.117567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.118015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1079.118127] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1079.118207] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1079.118294] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1079.118377] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1079.118461] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGH for action security_group_rules [ 1079.118546] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGH for action security_group_rules [ 1079.118627] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGH for action security_group_rules [ 1079.118703] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGH for action security_group_rules [ 1079.118783] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGH for action security_group_rules [ 1079.118847] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGH for action security_group_rules [ 1079.118928] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGH for action security_group_rules [ 1079.118992] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGH for action security_group_rules [ 1079.119076] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGH for action security_group_rules [ 1079.119141] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGH for action security_group_rules [ 1079.119466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 1079.119466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGH for action security_group_rules [ 1079.119466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGH for action security_group_rules [ 1079.119466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGH for action security_group_rules [ 1079.119466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGH for action security_group_rules [ 1079.119622] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGH for action security_group_rules [ 1079.119622] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGH for action security_group_rules [ 1079.119703] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGH for action security_group_rules [ 1079.119777] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGH for action security_group_rules [ 1079.119825] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGH for action security_group_rules [ 1079.119944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [req-c99fc5b4-2574-47da-a5a5-f0f1e17c5316 req-51d4edd3-03c3-477a-9195-5fd49f12f7bc service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [req-c99fc5b4-2574-47da-a5a5-f0f1e17c5316 req-51d4edd3-03c3-477a-9195-5fd49f12f7bc service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [req-c99fc5b4-2574-47da-a5a5-f0f1e17c5316 req-51d4edd3-03c3-477a-9195-5fd49f12f7bc service nova] Enqueued Resource ID: dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c with Priority: HIGHEST for action port [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c with Priority: HIGHEST for action port [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGH for action security_group_rules [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a with Priority: HIGH for action security_group_rules [ 1079.337794] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGH for action security_group_rules [ 1079.339029] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3373549f-c839-4d1c-a55a-af37a3148994 with Priority: HIGH for action security_group_rules [ 1079.339029] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 with Priority: HIGH for action security_group_rules [ 1079.339029] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01249833-e649-48c7-b9c6-9d9107bdff51 with Priority: HIGH for action security_group_rules [ 1079.339029] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGH for action security_group_rules [ 1079.339238] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGH for action security_group_rules [ 1079.339238] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdbb2071-5801-4662-9a75-aa174ebd2139 with Priority: HIGH for action security_group_rules [ 1079.339348] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176c448-4084-4ddf-b065-53b7560b7c98 with Priority: HIGH for action security_group_rules [ 1079.339384] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGH for action security_group_rules [ 1079.339474] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGH for action security_group_rules [ 1079.340010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 1079.340010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f with Priority: HIGH for action security_group_rules [ 1079.340010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 with Priority: HIGH for action security_group_rules [ 1079.340010] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef with Priority: HIGH for action security_group_rules [ 1079.340588] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e with Priority: HIGH for action security_group_rules [ 1079.340588] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08655f30-40a0-4bfa-8418-b72abb59f910 with Priority: HIGH for action security_group_rules [ 1079.340588] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e075408-82f5-4e52-84f7-426a04568f7e with Priority: HIGH for action security_group_rules [ 1079.340588] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c with Priority: HIGH for action security_group_rules [ 1079.340738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.340812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.340862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.341104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.341344] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.343313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.343450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.343641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.343765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.343828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.344694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.344694] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.344990] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.345132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.345200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.345396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.345476] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.350509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b54caf5-2187-4343-bc88-b3ec40430d8a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.350630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.350674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.350875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.350954] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b54caf5-2187-4343-bc88-b3ec40430d8a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.352929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.352929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.352929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.353131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.353281] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.354325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3373549f-c839-4d1c-a55a-af37a3148994 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.354442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.354492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.355140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.355140] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3373549f-c839-4d1c-a55a-af37a3148994',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.355599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.355738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.355801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.356756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.356756] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a393ca-d0ba-4ee5-9055-2295ecf1b143',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.356894] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01249833-e649-48c7-b9c6-9d9107bdff51 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.357014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.357066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.357277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.357353] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01249833-e649-48c7-b9c6-9d9107bdff51',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.358422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.358529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.358641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.358769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.358840] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.361242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.361341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.361542] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdbb2071-5801-4662-9a75-aa174ebd2139 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.361642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.361697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.363328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.363439] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdbb2071-5801-4662-9a75-aa174ebd2139',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176c448-4084-4ddf-b065-53b7560b7c98 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176c448-4084-4ddf-b065-53b7560b7c98',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.368019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.368019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.369225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.369225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.369425] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.369546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.369626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.369834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.369919] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd9e37a4-5f26-4f1d-91f1-8a66db647d9f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.370727] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3154b0-663b-480d-966a-1fbdbe6d7897 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.370838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.370898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.371090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.371169] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3154b0-663b-480d-966a-1fbdbe6d7897',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.371991] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.372185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.372263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.372375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.372451] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a9fd008-a5ab-421a-b65b-4aa0354d7aef',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.373784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.373784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.373784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.373784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.374041] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d7c80b-0893-40cf-bbe9-c943f87b4d3e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.374674] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08655f30-40a0-4bfa-8418-b72abb59f910 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.374807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.374887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.375427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.375484] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08655f30-40a0-4bfa-8418-b72abb59f910',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.376424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e075408-82f5-4e52-84f7-426a04568f7e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.376537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.376618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.376801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.376927] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e075408-82f5-4e52-84f7-426a04568f7e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.381203] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff45cfa-44be-4184-a622-fcee3f7d548c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.381341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.381429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.381640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.381736] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff45cfa-44be-4184-a622-fcee3f7d548c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.865026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.865026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.865026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.865026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.887735] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.888402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.892029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.892029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.892029] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.895401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.895990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.906264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.906264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.907175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.907520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.908251] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.908399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.908463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.908661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.908761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.908850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.908943] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.910029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.910202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.910202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.910396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.910552] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.910663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.910819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.911223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.911604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911805] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.919763] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c with status ACTIVE [ 1079.920051] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.920190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.920190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.920493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.920587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.920800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.920951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.921027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.921214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.921559] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.921657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.921746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.921875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.922069] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c is going to be updated. [ 1079.938617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.938825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.938867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.939321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.939569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.939733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.939868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.940063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.940168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.940298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.940432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.940547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.940751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.940859] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.941575] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.941769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.941871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.942078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.942225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.942339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.942441] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.994917] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.995222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.995222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.995461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.998300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.998502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.999475] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.999689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.001351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.001569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.006473] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.006747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.007526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.007659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.008595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.008595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.010196] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.010312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.011468] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.011587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.012628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.012805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.018385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.018524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.019320] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.019807] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.019935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.020581] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.021052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.021289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.021328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.021508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.021786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.021919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dce9d417-3d19-4ed4-bc68-4ac9ca6ada5c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.022662] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.023188] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.023296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.030360] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.030916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.031056] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.033104] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.033251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.033396] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b54caf5-2187-4343-bc88-b3ec40430d8a is going to be deleted. [ 1080.034415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.034646] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.056592] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-5b04d1b4-6db3-43e4-abea-ae2c20fddfdb tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1080.058067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.058250] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3154b0-663b-480d-966a-1fbdbe6d7897 is going to be deleted. [ 1080.059672] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1080.059914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.060233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.061918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.062069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.062347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.062556] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.062697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.063049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.063149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.063273] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.083767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.083951] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdbb2071-5801-4662-9a75-aa174ebd2139 is going to be deleted. [ 1080.085249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.085499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.118317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.118534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.123463] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 4s [ 1080.124981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.125187] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d7c80b-0893-40cf-bbe9-c943f87b4d3e is going to be deleted. [ 1080.126180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.126348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.164977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.165571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.167594] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1080.168446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.168446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.169262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.171021] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.171021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.171021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.171021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.171021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.171021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.171021] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.173023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.173395] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08655f30-40a0-4bfa-8418-b72abb59f910 is going to be deleted. [ 1080.174645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.175954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.185949] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.185949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.220369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.220369] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176c448-4084-4ddf-b065-53b7560b7c98 is going to be deleted. [ 1080.221942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.223091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.247933] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.247933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.289988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.289988] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd9e37a4-5f26-4f1d-91f1-8a66db647d9f is going to be deleted. [ 1080.291080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.293031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.369347] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.399191] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.399777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.399925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.400193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.400396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.400518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.400609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.400788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.400885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.400972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.401149] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.401247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.401305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.401452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.401595] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.401687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.401774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.401883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.401960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.402123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.402243] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.414570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.414740] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01249833-e649-48c7-b9c6-9d9107bdff51 is going to be deleted. [ 1080.415822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.416515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.425623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.425839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.432284] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.454136] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1080.469478] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-4d901bad-a7b4-47ea-8b47-2b5b58c93d3b tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1080.470037] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1080.470571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.470571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.479582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.479762] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a9fd008-a5ab-421a-b65b-4aa0354d7aef is going to be deleted. [ 1080.480794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.481038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.482590] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.482798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.490435] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.490581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.510667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.510992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.531080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.531332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff45cfa-44be-4184-a622-fcee3f7d548c is going to be deleted. [ 1080.535167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.535167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.566406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.567159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.580372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.580664] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e075408-82f5-4e52-84f7-426a04568f7e is going to be deleted. [ 1080.581593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.581843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.584468] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.584827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.653891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.654209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be deleted. [ 1080.655269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.655550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.677693] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.688584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.688808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.696831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.698440] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3373549f-c839-4d1c-a55a-af37a3148994 is going to be deleted. [ 1080.699020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.699283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.731788] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.731955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.770038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.770250] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a393ca-d0ba-4ee5-9055-2295ecf1b143 is going to be deleted. [ 1080.772952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.772952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.772952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.772952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b54caf5-2187-4343-bc88-b3ec40430d8a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.772952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.773412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.773508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.773641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3154b0-663b-480d-966a-1fbdbe6d7897" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.774473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.775052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.775052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.775052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdbb2071-5801-4662-9a75-aa174ebd2139" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.775052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.776448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.776448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.776448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d7c80b-0893-40cf-bbe9-c943f87b4d3e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.777355] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.777682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.777771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.777924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.778041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e075408-82f5-4e52-84f7-426a04568f7e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.778448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.778522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08655f30-40a0-4bfa-8418-b72abb59f910" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.778900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.778975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.779145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd9e37a4-5f26-4f1d-91f1-8a66db647d9f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.779221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.779362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.779438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.779534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176c448-4084-4ddf-b065-53b7560b7c98" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.779643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.779779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.829589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.829903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.830043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.830111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.830353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.830458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.830646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.830757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.830817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.831267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.831420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.834030] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.834030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.834030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.834030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.834030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.834030] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1080.834030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01249833-e649-48c7-b9c6-9d9107bdff51" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a9fd008-a5ab-421a-b65b-4aa0354d7aef" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.835514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff45cfa-44be-4184-a622-fcee3f7d548c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.874550] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f159146-6707-4314-98f2-9023803a47fc: rpc.has_security_group_logging(os_id): False [ 1080.888034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.888390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.888538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.888636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.888895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.889045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.889209] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1080.893468] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.893706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.893803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.894052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.894153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.894282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.897481] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.897589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.897643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.897866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.897957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.898100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3373549f-c839-4d1c-a55a-af37a3148994" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.908080] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac836d8b-740c-4a34-ae58-041041eb8e77: rpc.has_security_group_logging(os_id): False [ 1080.924790] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.925486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.925699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.928183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.928183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.928183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a393ca-d0ba-4ee5-9055-2295ecf1b143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.928812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.929116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.929349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.929705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.937297] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f3cb76-3fba-47b9-bac9-ea6821feb810: rpc.has_security_group_logging(os_id): False [ 1080.950573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.950573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.974079] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.974079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.982259] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.982259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.982259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.982259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.982259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.984220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.985252] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.985543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.985710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.986817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.986817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.986817] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1080.989940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.990082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.036575] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1081.058119] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.059459] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-512" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.059763] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-512" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.060239] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-512" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.060606] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.060792] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.060994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.061331] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.061701] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.062048] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.062180] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.062297] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.062410] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.062527] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.062638] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.063331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.065714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.065866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.092843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.093494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.093698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.093747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.093975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.094112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.094299] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.094397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.094463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.094618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.094689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.095128] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.095230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.095276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.095420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.095493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.095591] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 1081.097297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.099031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.180433] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e026144d-94fe-4b76-82b5-8dd361aa66d8: rpc.has_security_group_logging(os_id): False [ 1081.226141] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.226395] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.163 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.226522] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.227342] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-512" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.227519] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.227806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.228263] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.228714] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.228857] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2799ba29-d00d-40c4-b0a6-cfd5e74122a2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.240825] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.240825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.249146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.249146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.249146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.249146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.249146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.249146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.249146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 is going to be updated. [ 1081.250346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.250855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.251224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.252548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.252970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.268239] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.268443] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.278626] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1081.297067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.297577] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.297742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.297847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.298226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.298299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.298457] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1081.301362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.301540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.301788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.350061] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.350313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.350313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.350558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.350778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.395442] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1081.405509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.405749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.405804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.405992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.406163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.417971] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 1081.424116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: IN_PROGRESS for 2s [ 1081.489200] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.489667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.489754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.490228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.490371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.513885] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1081.734536] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.734923] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.735134] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.735464] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.735777] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.736068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 not found, creating... [ 1081.736332] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.736526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.736647] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.736991] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.737267] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.737630] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.737871] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.738066] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.738484] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.738564] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.738760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 is going to be created. [ 1081.766967] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.767410] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.767597] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.767948] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.768223] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.768552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.137306] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1082.137306] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.137306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.137306] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.137306] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.475491] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-3ace280e-686e-46d1-8e41-81506d9dade0 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1082.475698] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-3ace280e-686e-46d1-8e41-81506d9dade0 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1082.475887] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-3ace280e-686e-46d1-8e41-81506d9dade0 service nova] Enqueued Resource ID: 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 with Priority: HIGHEST for action port [ 1082.476207] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1082.476337] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1082.476391] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 with Priority: HIGHEST for action port [ 1082.476953] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.479726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.479726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.479726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.479726] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.480457] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.480550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.480751] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.480853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.480914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.481103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.481493] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2799ba29-d00d-40c4-b0a6-cfd5e74122a2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.639021] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.984175] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.984376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.984655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 with status ACTIVE [ 1082.984883] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.985040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.985158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.985530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.985621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.985824] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.985951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.986057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.986269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.986369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.986605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.986747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.986846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.987049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.987166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.987348] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2799ba29-d00d-40c4-b0a6-cfd5e74122a2 is going to be updated. [ 1083.018154] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.018154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.018154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.018154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.018154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.018154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2799ba29-d00d-40c4-b0a6-cfd5e74122a2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.049690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1083.049920] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 deletion is rescheduled due to dependency. [ 1083.050080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.050322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.050626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.051044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.051209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.051318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.051678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.051831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.052030] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.141419] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.295431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1083.295722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.351086] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.351323] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-583" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.351452] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-583" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.351788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-583" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.352074] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.352242] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.352364] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.352630] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.352825] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.353073] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.353203] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.353318] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.353432] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.353547] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.353659] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.353800] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.375023] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.375023] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.375023] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.375023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-583" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.375023] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-fd061047-628c-4ecc-89a5-168928a0a2d3 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.375023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.375023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.375023] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.375023] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd061047-628c-4ecc-89a5-168928a0a2d3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.409071] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1083.410073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.438357] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 1083.438724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.440520] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: SUCCESS [ 1083.440726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.530293] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1083.530525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.530736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.531019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.531120] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.555658] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.645026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.645305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.645305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.645674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.645674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.645808] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1083.676994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.677167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.677238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.677497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.677681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.687616] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1083.876737] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.876952] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.877177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.877499] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.877673] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.877866] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port fd061047-628c-4ecc-89a5-168928a0a2d3 not found, creating... [ 1083.878176] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.878390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.878526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.878818] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.878966] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.879288] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.879452] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.879610] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.879837] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.879977] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.880137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: fd061047-628c-4ecc-89a5-168928a0a2d3 is going to be created. [ 1083.905413] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.905752] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.905838] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.906321] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.906827] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.907245] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.034101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.034101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.034101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.034376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.034463] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.036814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.036814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.036814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.036814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.036814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.036814] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.059426] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.537228] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.562201] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.562400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.562475] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.562701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.562875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.563506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1084.603939] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.604108] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.604189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.608020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.608020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.621999] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1084.753663] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-7a1c3880-1cac-4e03-a15f-2bde702270e6 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1084.753850] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-7a1c3880-1cac-4e03-a15f-2bde702270e6 service nova] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1084.754072] env[69350]: INFO networking_nsxv3.common.synchronization [req-0086119a-0851-44fa-914b-c520cf6b2da6 req-7a1c3880-1cac-4e03-a15f-2bde702270e6 service nova] Enqueued Resource ID: fd061047-628c-4ecc-89a5-168928a0a2d3 with Priority: HIGHEST for action port [ 1084.754726] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_rules [ 1084.754898] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1084.755110] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd061047-628c-4ecc-89a5-168928a0a2d3 with Priority: HIGHEST for action port [ 1084.755509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.755643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.755858] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.755967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.756214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd061047-628c-4ecc-89a5-168928a0a2d3 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.756329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.756404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.756661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.756755] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd061047-628c-4ecc-89a5-168928a0a2d3',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.040078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e026144d-94fe-4b76-82b5-8dd361aa66d8: rpc.has_security_group_logging(os_id): False [ 1085.059781] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.060022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.060106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.060351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.060446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.060907] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.061059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.061059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.061458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.061458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.061458] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1085.130672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.130672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.130672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.130672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.130672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.149506] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1085.259876] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd061047-628c-4ecc-89a5-168928a0a2d3 with status ACTIVE [ 1085.260209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.260363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.260412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.260707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.260770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.261139] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.261267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.261369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.261543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.261655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.261909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.262034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.262458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.262458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.262458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.262616] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd061047-628c-4ecc-89a5-168928a0a2d3 is going to be updated. [ 1085.307920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.307920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.307920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.307920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.307920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.307920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd061047-628c-4ecc-89a5-168928a0a2d3" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.637266] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9e2c0a47-2f9c-4531-9174-f7cfc9fe7130 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: a318c2df-5e71-495e-91e9-d90d434fe247 with Priority: HIGHEST for action security_group_rules [ 1085.637784] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a318c2df-5e71-495e-91e9-d90d434fe247 with Priority: HIGHEST for action security_group_rules [ 1085.638306] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a318c2df-5e71-495e-91e9-d90d434fe247 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.638620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.638865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639520] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a318c2df-5e71-495e-91e9-d90d434fe247',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.700034] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.700034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.700034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.700034] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.781428] env[69350]: INFO networking_nsxv3.common.synchronization [None req-48a7b666-56fc-4933-851f-406714071bd2 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: a318c2df-5e71-495e-91e9-d90d434fe247 with Priority: HIGHEST for action security_group_rules [ 1085.781428] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a318c2df-5e71-495e-91e9-d90d434fe247 with Priority: HIGHEST for action security_group_rules [ 1085.781428] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a318c2df-5e71-495e-91e9-d90d434fe247 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.781428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.161708] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.161708] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a318c2df-5e71-495e-91e9-d90d434fe247 already deleted. [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.161708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.161708] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a318c2df-5e71-495e-91e9-d90d434fe247',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.202134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.202338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.202402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.203206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.203331] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.203450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.203523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.203702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.203803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.203922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.204107] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.204325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.204325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.204566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.204828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.204902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.204902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.205091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.205192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.205321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.205455] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.636409] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1086.636670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.636928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.637691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.637691] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.637691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.637691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.637691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.638191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.638191] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.681989] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.681989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.682356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.682356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.682439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.682562] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a318c2df-5e71-495e-91e9-d90d434fe247 already deleted. [ 1086.682666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a318c2df-5e71-495e-91e9-d90d434fe247" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.707727] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 1086.727628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.727779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.727849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.728086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.753765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754058] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.754187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.754470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.754554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754764] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.754879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.755408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.755408] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.756044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.756044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.756044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.756044] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1086.829997] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.829997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.829997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.831342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.831342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.846053] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1087.142544] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.163918] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1087.163918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.506198] env[69350]: INFO networking_nsxv3.common.synchronization [req-6da1a31a-7cac-4f06-9e5d-6a8324efb5ba req-fbf904cd-0393-40a3-b7c2-16c9333f9e5f tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1087.507175] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1087.507741] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.508077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.508314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.508746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.509049] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.509279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.509430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.509673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.509843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.510026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.644556] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.013114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.014942] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.015096] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.017323] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.017648] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.017935] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.018130] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.018248] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.018509] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.018766] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.018959] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.019087] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.019202] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.019343] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.019465] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.019583] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.019713] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.044949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.045158] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.045556] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.045809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.046152] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-ac113e8a-d04d-485d-83be-293a69be43ff taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.046337] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.046462] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.046950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.047035] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac113e8a-d04d-485d-83be-293a69be43ff',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.149337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.150122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.150122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.150337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.150337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.150479] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1088.199697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.199970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.200110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.200432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.200686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.220047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1088.524162] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.553028] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.553028] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port ac113e8a-d04d-485d-83be-293a69be43ff not found, creating... [ 1088.553028] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.553028] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.553684] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.553684] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.554063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.554063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.554214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.554362] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: ac113e8a-d04d-485d-83be-293a69be43ff is going to be created. [ 1088.582324] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.582628] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.582803] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.583270] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.583578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.584021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.871480] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1088.871850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.871962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.872549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.872704] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.029729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.030026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.030111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.030376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.030519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.030675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1089.084370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.084563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.084618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.085048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.085246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.102927] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1089.375401] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.375664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.375779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.376334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.376334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.376608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.376608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.376757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.376816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.376906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.377091] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.435471] env[69350]: INFO networking_nsxv3.common.synchronization [req-ece09dab-d50a-47da-b59e-346e46fec7d1 req-ce694ed8-2549-4a89-badd-b72f519d5e34 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1089.437260] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1089.437260] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.437260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.437260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.437260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.437260] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.437560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.437560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.437680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.437726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.437798] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.860166] env[69350]: INFO networking_nsxv3.common.synchronization [req-6da1a31a-7cac-4f06-9e5d-6a8324efb5ba req-2fe991a8-e70b-4390-a1ce-26c66b652dca service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1089.860166] env[69350]: INFO networking_nsxv3.common.synchronization [req-6da1a31a-7cac-4f06-9e5d-6a8324efb5ba req-2fe991a8-e70b-4390-a1ce-26c66b652dca service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1089.860166] env[69350]: INFO networking_nsxv3.common.synchronization [req-6da1a31a-7cac-4f06-9e5d-6a8324efb5ba req-2fe991a8-e70b-4390-a1ce-26c66b652dca service nova] Enqueued Resource ID: ac113e8a-d04d-485d-83be-293a69be43ff with Priority: HIGHEST for action port [ 1089.860166] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1089.860166] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1089.861124] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac113e8a-d04d-485d-83be-293a69be43ff with Priority: HIGHEST for action port [ 1089.865114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.865114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.865114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.865114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac113e8a-d04d-485d-83be-293a69be43ff taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.865114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.865114] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac113e8a-d04d-485d-83be-293a69be43ff',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.882152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.882152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.882152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.882152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.882152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.882997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.889421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.889421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.889421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.889421] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.940581] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.941208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.941208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.941208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.962471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.962750] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.962937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.962937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.963171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.963261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.963337] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1089.994997] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.995586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.995790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.995901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.996083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.010081] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1090.067693] env[69350]: INFO networking_nsxv3.common.synchronization [req-4cfe8d29-d0f3-4c46-be5c-b321732eee2e req-fdc1e776-bd10-483b-8301-5e6b77f656c2 tempest-ImagesOneServerTestJSON-442764698 tempest-ImagesOneServerTestJSON-442764698-project-member] Enqueued Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1090.069188] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGHEST for action security_group_members [ 1090.069574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.069725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.070087] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.070344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.070518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.070891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.070981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.071155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.071239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.071335] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.095642] env[69350]: INFO networking_nsxv3.common.synchronization [None req-bc62c0fc-c854-45b3-af1b-0893fe742c62 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1090.096227] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1090.096785] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.096920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.096995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.097806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.097806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.102026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.102026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.102026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.102026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.102026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.231351] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1090.232967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.232967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.233332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.233708] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.234287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.234287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.235472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.235472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.235472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.235472] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.236315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.236639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.237435] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.239205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.239205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.239205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.239205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.239205] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.367979] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac113e8a-d04d-485d-83be-293a69be43ff with status ACTIVE [ 1090.368321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.368642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.368642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.369226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.369226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.369358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.369531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.369710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.369951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.370419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.370419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.370419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.370718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.370830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.370979] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac113e8a-d04d-485d-83be-293a69be43ff is going to be updated. [ 1090.373265] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.373265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.396717] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 1090.403713] env[69350]: INFO networking_nsxv3.common.synchronization [req-b0233506-4769-437b-aa7a-b738d28bf9e3 req-0d734038-2865-41ce-823c-e17970b39315 tempest-ServerMetadataTestJSON-1956134030 tempest-ServerMetadataTestJSON-1956134030-project-member] Enqueued Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1090.403713] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1090.403916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.403995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.404072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.405036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.405036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.405036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.405036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.405036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.405036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.405036] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.417385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.417385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.417385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.417385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.417627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.417691] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.417799] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.417864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.418027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.418106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.418319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.418428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.418481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.418627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.418699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.418887] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.418972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.419604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.419863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.420017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.420174] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1090.424248] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.425221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.425526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.425693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.425906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.426146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac113e8a-d04d-485d-83be-293a69be43ff" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.542968] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.543189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.543296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.543530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.543702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.562288] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1090.577764] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.577764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.577764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.577764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.604551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.605255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.634113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.636122] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.636122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.636122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.636122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.636122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.636122] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 is going to be updated. [ 1090.639518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.640204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.666634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.667299] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.667596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.667774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.668802] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.668965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.669161] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1090.731116] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.731270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.731359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.731611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.731753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.738704] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.738857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.738944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.739186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.739324] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.745447] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.745447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.745447] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.751774] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: IN_PROGRESS for 2s [ 1090.763323] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1090.907903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.908287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.908287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.908482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.908579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.908860] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.909069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.909128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.909378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.909491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.909622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 already deleted. [ 1090.909728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.978420] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.978647] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.978792] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.979486] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.979792] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.979968] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.980124] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.980397] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.980555] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981545] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.981545] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.981545] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.981545] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.981675] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.982324] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.982324] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.009877] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.010057] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.010200] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.010392] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-844" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.010728] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4c7a7240-ac4d-46a0-983e-82796079bee1 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.010950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.011095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.011450] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.011599] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7a7240-ac4d-46a0-983e-82796079bee1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.117136] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1091.117394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.117573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.117812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.118117] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.118409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.118409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.118519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.118571] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.118671] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.256648] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.514403] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.514658] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.514791] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.515158] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.515379] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.515586] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4c7a7240-ac4d-46a0-983e-82796079bee1 not found, creating... [ 1091.515854] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.516037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.516165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.516400] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.516538] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.516820] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.517030] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.517494] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.517811] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.518014] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.518723] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4c7a7240-ac4d-46a0-983e-82796079bee1 is going to be created. [ 1091.542561] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.542795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.542967] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.543337] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.543583] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.543820] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.622594] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.757800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.758234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.758330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.758813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.758924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.759068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1091.803273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.803994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.804240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.804682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.805090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.819131] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1092.027795] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1092.028187] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1092.028187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.125615] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.544416] env[69350]: INFO networking_nsxv3.common.synchronization [req-b0233506-4769-437b-aa7a-b738d28bf9e3 req-19e6655a-0634-45cf-b9fb-4414868872e6 service nova] Enqueued Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_rules [ 1092.544696] env[69350]: INFO networking_nsxv3.common.synchronization [req-b0233506-4769-437b-aa7a-b738d28bf9e3 req-19e6655a-0634-45cf-b9fb-4414868872e6 service nova] Enqueued Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1092.544834] env[69350]: INFO networking_nsxv3.common.synchronization [req-b0233506-4769-437b-aa7a-b738d28bf9e3 req-19e6655a-0634-45cf-b9fb-4414868872e6 service nova] Enqueued Resource ID: 4c7a7240-ac4d-46a0-983e-82796079bee1 with Priority: HIGHEST for action port [ 1092.545562] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_rules [ 1092.545774] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1092.545961] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7a7240-ac4d-46a0-983e-82796079bee1 with Priority: HIGHEST for action port [ 1092.546409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.546549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.546748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.546910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.546996] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.547945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.549600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.549600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.549600] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.549952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7a7240-ac4d-46a0-983e-82796079bee1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.549952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.549952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.550112] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.550422] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7a7240-ac4d-46a0-983e-82796079bee1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.580340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1092.580588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.628909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.629188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.629529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.630525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.630695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.630817] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1092.664019] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.664238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.664314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.664534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.664684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.675799] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1092.767780] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 in Status: SUCCESS [ 1092.768145] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 deletion is rescheduled due to dependency. [ 1092.768329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.777508] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1092.777762] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d deletion is rescheduled due to dependency. [ 1092.777851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.055025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.055025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.055025] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.055025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7a7240-ac4d-46a0-983e-82796079bee1 with status ACTIVE [ 1093.055025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.055025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.055025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.055025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.055025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.055025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.057145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.057398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.060137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.060137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.060137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7a7240-ac4d-46a0-983e-82796079bee1 is going to be updated. [ 1093.083307] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.083535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.083630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.083896] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.084120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.084368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7a7240-ac4d-46a0-983e-82796079bee1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.198897] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.199301] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.199464] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.200552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.200552] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.200552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.200880] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.201024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.201227] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.201571] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.201722] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.201887] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.202132] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.202259] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.202395] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.202577] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.231078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.231078] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.231078] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.231078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-978" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.231078] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e4da15c3-07cd-457f-982d-4f8bf20746fc taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.231078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.231078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.231078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.231078] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4da15c3-07cd-457f-982d-4f8bf20746fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.560593] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.736504] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.736765] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.736902] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.737284] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.737447] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.737815] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.738265] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.738426] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.738681] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.738843] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.739203] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.739385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.739482] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.739696] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.739883] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.740023] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e4da15c3-07cd-457f-982d-4f8bf20746fc is going to be updated. [ 1093.766703] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.766957] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.767104] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.767409] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.767662] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.767940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.835313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1093.835503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.835692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.835970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.836209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.836337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.836406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.836582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.836687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.836781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.836962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.837312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.837383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.837557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.837719] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.837827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.837879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.838036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.838145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.838232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.838359] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.063392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.063784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.063784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.064136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.064262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.064422] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 is going to be created. [ 1094.092420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.092670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.092792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.093095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.093325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.119432] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: UNINITIALIZED for 2s [ 1094.345060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c926423-569b-4b98-81ac-723b20e82ff8: rpc.has_security_group_logging(os_id): False [ 1094.370033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.370033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.370033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.370033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.370827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.371104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.372036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.372036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.372036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.372036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.372036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.372567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.372798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.373067] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1094.457134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.457134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.457134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.457134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.457134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.481038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1094.676276] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bdce048-30cc-463c-9cf5-e6b088045da7 req-7c75c163-dacd-4925-895b-7400266c4264 service nova] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 1094.676276] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bdce048-30cc-463c-9cf5-e6b088045da7 req-7c75c163-dacd-4925-895b-7400266c4264 service nova] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1094.676276] env[69350]: INFO networking_nsxv3.common.synchronization [req-5bdce048-30cc-463c-9cf5-e6b088045da7 req-7c75c163-dacd-4925-895b-7400266c4264 service nova] Enqueued Resource ID: e4da15c3-07cd-457f-982d-4f8bf20746fc with Priority: HIGHEST for action port [ 1094.676276] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_rules [ 1094.676674] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1094.677065] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4da15c3-07cd-457f-982d-4f8bf20746fc with Priority: HIGHEST for action port [ 1094.678726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.679083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.679322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.679881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.681071] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.683046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.683046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.683046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.683046] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.687330] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4da15c3-07cd-457f-982d-4f8bf20746fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.687330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.687330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.687330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.687330] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4da15c3-07cd-457f-982d-4f8bf20746fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.697881] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1094.698400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.698700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.699062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.699335] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.699568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.699708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.699987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.700154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.700369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.700705] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.739736] env[69350]: INFO networking_nsxv3.common.synchronization [req-f464d054-0080-4361-92ab-6d9da0f43518 req-d744c5a5-565e-4ef7-bfd0-e66505b7534c tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1094.740383] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1094.740751] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.740895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.740958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.742183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.742360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.742471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.742555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.742774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.743082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.743221] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.188783] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.190403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.190552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.191806] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4da15c3-07cd-457f-982d-4f8bf20746fc with status ACTIVE [ 1095.191806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.191806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.191806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.191806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.191806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.191806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.192096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.192096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.192745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.192838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.193114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.194034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.194181] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.194428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.194524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.194624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4da15c3-07cd-457f-982d-4f8bf20746fc is going to be updated. [ 1095.203782] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.203957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.204084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.204323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.204491] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.204592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.204655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.204805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.204891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.204989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.205155] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.205257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.205295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.205440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.205592] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.205669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.205736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.205979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.205979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.206882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.207101] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.229786] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.230047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.230142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.230413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.230557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.230841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4da15c3-07cd-457f-982d-4f8bf20746fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.245462] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.245652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.245769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.246226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.246226] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.247723] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.247723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.247723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.247723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.247723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.247723] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1095.283424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.283684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.283740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.284028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.284250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.307988] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1095.697586] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.709240] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 1095.731374] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.731543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.731602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.731817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.757116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.757530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.758334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.758334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.758334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.758334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.758334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.758334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.758997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.758997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.758997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.758997] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.758997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.759339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.759339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.759471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.759637] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1095.836269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.836269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.836269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.836269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.836269] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.854280] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1095.970025] env[69350]: INFO networking_nsxv3.common.synchronization [req-8ae250f4-751d-4f0c-9ac9-5b694d17adeb req-170d512c-9f9f-4428-9108-4b9626dd1ccf tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1095.970025] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1095.970025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.970025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.970025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.970631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.970961] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.971204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.971358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.971658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.971838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.972059] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.132731] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: UNINITIALIZED for 4s [ 1096.202654] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.203330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.203330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.203440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.203702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.203805] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be updated. [ 1096.261605] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.263029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.263029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.263029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.263029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.274572] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: IN_PROGRESS for 2s [ 1096.474557] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.474741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.474833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.475068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.475160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.475356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.475519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.475604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.475683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.475765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.475838] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1096.503282] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1096.503511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.503746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.504012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.504175] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.508398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.508488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.508553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.508732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.508875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.522413] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1096.530669] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.531122] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.531635] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.531759] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.532126] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.532395] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.532577] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.532894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.533178] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.533456] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.533609] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.533774] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.534042] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.534245] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.534472] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.534682] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.557278] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.557580] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.557778] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.557971] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.558306] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-aaed26df-a5e6-42b5-b85c-a631686e5e15 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.558482] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.558604] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.558940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.559104] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaed26df-a5e6-42b5-b85c-a631686e5e15',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.006561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.006801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.006801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.006997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.007267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.007494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.007560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.007748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.008104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.008104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.008104] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.061109] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.061341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.061485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.061813] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.061973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.062149] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port aaed26df-a5e6-42b5-b85c-a631686e5e15 not found, creating... [ 1097.062807] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.063165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.063165] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.063466] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.063558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.063884] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.064061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.064184] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.064403] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.064542] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.064684] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: aaed26df-a5e6-42b5-b85c-a631686e5e15 is going to be created. [ 1097.087229] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.087418] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.087517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.087810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.088069] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.088304] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.317958] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1097.318451] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1097.318451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.510662] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.510856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.511054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.511304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.511467] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.511848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.511848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.511975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.512083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.512204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.512371] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.512640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.512640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.512729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.514270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.514270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.514270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.514270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.514270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.514270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.514270] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.576767] env[69350]: INFO networking_nsxv3.common.synchronization [req-441117af-038d-461c-9e30-8947e445badb req-ae8c4f6e-e498-4f61-8ef2-c553e95e7db2 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1097.578478] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1097.578995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.583113] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.583113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.583113] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.877104] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1097.877104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.985304] env[69350]: INFO networking_nsxv3.common.synchronization [req-441117af-038d-461c-9e30-8947e445badb req-d1f961f5-c079-44c9-aac1-76ebfdb55b84 tempest-ServersTestMultiNic-1094546435 tempest-ServersTestMultiNic-1094546435-project-member] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1097.986391] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGHEST for action security_group_members [ 1097.987023] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.987219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.016319] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c926423-569b-4b98-81ac-723b20e82ff8: rpc.has_security_group_logging(os_id): False [ 1098.036165] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.036350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.036528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.037411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.037411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.037411] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.038175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.038175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.038175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.038175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.038325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.038372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.038413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.038752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.038752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.039368] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.039533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.039605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.039810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.039858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.040493] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1098.087059] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.132843] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.133196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.133328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.133702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.133966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.152290] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: SUCCESS [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.152290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.152290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.152290] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [req-8ae250f4-751d-4f0c-9ac9-5b694d17adeb req-36c5c612-79eb-45db-9f84-87d30b4da18d service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [req-8ae250f4-751d-4f0c-9ac9-5b694d17adeb req-36c5c612-79eb-45db-9f84-87d30b4da18d service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [req-8ae250f4-751d-4f0c-9ac9-5b694d17adeb req-36c5c612-79eb-45db-9f84-87d30b4da18d service nova] Enqueued Resource ID: aaed26df-a5e6-42b5-b85c-a631686e5e15 with Priority: HIGHEST for action port [ 1098.168137] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1098.168137] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaed26df-a5e6-42b5-b85c-a631686e5e15 with Priority: HIGHEST for action port [ 1098.168682] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.169582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.169670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.169996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.170157] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.171396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.171575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.171960] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaed26df-a5e6-42b5-b85c-a631686e5e15 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.172077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.172125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.173327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.173327] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaed26df-a5e6-42b5-b85c-a631686e5e15',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.287899] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: SUCCESS [ 1098.288254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.288574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.288946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.289373] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.289460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.289582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.289865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.290042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.290223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.290392] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.535024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1098.535024] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.535024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.535024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.535024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.590109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.659210] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.659210] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.659210] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.659210] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.659210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.659942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.659942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.659942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.659942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.659942] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.678024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaed26df-a5e6-42b5-b85c-a631686e5e15 with status ACTIVE [ 1098.678024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.678024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.678024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.678024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.678642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.678642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.678642] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaed26df-a5e6-42b5-b85c-a631686e5e15 is going to be updated. [ 1098.724071] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.724071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.724071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.724071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.724071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.724071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaed26df-a5e6-42b5-b85c-a631686e5e15" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.792820] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.038526] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.091877] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.092361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.092452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.092727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.092809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.092913] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1099.164013] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cefdec3-6da8-484c-9ff1-2845e8cd40a7: rpc.has_security_group_logging(os_id): False [ 1099.169757] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.170075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.170127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.170421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.170613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.183485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1099.191129] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.191396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.191506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.191934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.192065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.192416] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.192600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.192710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.193045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.193183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.193531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.193717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.193819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.194100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.194221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.194562] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.194709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.194805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.195072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.195209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.195353] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 is going to be created. [ 1099.276547] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.276729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.276793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.277391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.277391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.292360] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: IN_PROGRESS for 2s [ 1099.295743] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0eab42b-aa65-450c-a7c9-ef9dfeea65c1: rpc.has_security_group_logging(os_id): False [ 1099.319429] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.319697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.319854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.320219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.320394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.320791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.320993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.321491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.321793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.322090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.322283] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be created. [ 1099.438182] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.438492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.438751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.440251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.440251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.466986] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: IN_PROGRESS for 2s [ 1099.542138] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.046722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.046951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.047071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.047414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.047551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.047741] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1100.082052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.082293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.082371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.082609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.082757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.093616] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1100.207519] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1100.207519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.196492] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.196492] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.196492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.196492] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.307690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: SUCCESS [ 1101.307690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.484436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: SUCCESS [ 1101.484962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.699851] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.700167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.700316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.700608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.700821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.701105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.701272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.701398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.701640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.701777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.701943] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be updated. [ 1101.729472] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.729780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.729925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.730223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.730477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.743059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: IN_PROGRESS for 2s [ 1102.109043] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1102.109043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.109043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.109043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.109043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.109043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.109786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.110878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.110878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.110878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.110878] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.187490] env[69350]: INFO networking_nsxv3.common.synchronization [req-e0f20310-b7b1-47df-a30c-d816374a1d38 req-b6e14d08-be7b-406e-9582-e2ff4d2447c4 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1102.188597] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1102.188945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.195118] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.195118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.195118] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.615903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.615903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.615903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.615903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.616322] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.616322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.616322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.616429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.616756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.616756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.616756] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.616909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.616909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.617151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.617278] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.617376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.617437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.619639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.619639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.619639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.619639] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.697187] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.697612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.697788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.698223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.698540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.699356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.699356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.699356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.699356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.699356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.699611] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1102.734339] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.734555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.734555] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.734726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.734827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.746325] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1103.120121] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f77ff482-c36b-41a0-9c84-caa4cc51cf3d: rpc.has_security_group_logging(os_id): False [ 1103.142691] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.142889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.142966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.143281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.143381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.144116] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.144265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.144343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.145347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.145420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.146611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.146733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.146801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.147010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.147109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.147340] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.147446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.147512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.147672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.147752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.147843] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1103.234338] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.234560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.234560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.234781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.235117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.255195] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1103.752731] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c926423-569b-4b98-81ac-723b20e82ff8 in Status: SUCCESS [ 1103.752994] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 deletion is rescheduled due to dependency. [ 1103.753063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.761485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1104.761809] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1104.761941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.276443] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1105.277296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.919914] env[69350]: INFO networking_nsxv3.common.synchronization [req-cfe4b323-6c3d-46dd-b947-698b381f26b9 req-521a4a48-20d3-4edf-82bb-4e0919b43b53 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1105.923266] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1105.926013] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.926704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.926704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.926704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.926704] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.926704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.927015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.927015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.927015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.927176] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.188772] env[69350]: INFO networking_nsxv3.common.synchronization [req-dbd90c7c-e3d9-4936-aafd-e9b02a644655 req-756450dd-55d1-4d5b-88ad-265caeefd438 tempest-ServerActionsV293TestJSON-1388554867 tempest-ServerActionsV293TestJSON-1388554867-project-member] Enqueued Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1106.189427] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b with Priority: HIGHEST for action security_group_members [ 1106.189741] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.189869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.189959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.190207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.190364] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.190459] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.190553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.190726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.191418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.191418] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce5d9ba7-7740-404a-9bcb-b276b50dbc4b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.430822] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.430992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.431142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.431391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.431510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.431775] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.431903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.431968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.432149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.432352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.432352] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1106.462411] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.462700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.462700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.463175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.463175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.475813] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1106.695621] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.695621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.695621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.695621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.726600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.726600] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.726600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.726600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.726600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.726600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.726600] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b is going to be updated. [ 1106.756574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.756755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.756755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.757106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.757288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.767413] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: IN_PROGRESS for 2s [ 1106.996345] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.996345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.996345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.996345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003059] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.003059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.003059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.003059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003059] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.003059] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.003059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.003059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.003059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.003059] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.003059] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.003059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.026422] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.026422] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.026422] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.026422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.026422] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-09c31512-f51d-45fa-80b9-a29eed026c8d taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.026422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.026422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.026422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.027124] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c31512-f51d-45fa-80b9-a29eed026c8d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.529811] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.529940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.530063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.530382] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.530555] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.530718] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 09c31512-f51d-45fa-80b9-a29eed026c8d not found, creating... [ 1107.530989] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.531313] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.531437] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.531657] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.531793] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.532914] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.535064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.535064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.535064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.535064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.535064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 09c31512-f51d-45fa-80b9-a29eed026c8d is going to be created. [ 1107.557704] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.557704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.557704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.557704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.558888] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.558888] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.244844] env[69350]: INFO networking_nsxv3.common.synchronization [req-edd63a10-a749-462c-b983-03a08046b4ec req-d3aa8bca-894c-4b06-8b6d-6a2d2aaf6d00 tempest-ServersNegativeTestJSON-814899616 tempest-ServersNegativeTestJSON-814899616-project-member] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 1108.245591] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGHEST for action security_group_members [ 1108.245947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.250203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.250329] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.250634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.250826] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.250952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.251014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.251187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.251276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.251420] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.394981] env[69350]: INFO networking_nsxv3.common.synchronization [req-0dee133e-932b-4d45-b511-2c7851481da6 req-b830aadf-b216-4a23-b2be-f8fd3d3117cf tempest-ServerMetadataTestJSON-1956134030 tempest-ServerMetadataTestJSON-1956134030-project-member] Enqueued Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1108.395645] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGHEST for action security_group_members [ 1108.396492] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.396722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.396831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.397073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.397299] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.397414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.397497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.397748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.397867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.397983] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.490962] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1108.490962] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1108.490962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.756551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.756736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.756801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.758063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.758063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.758509] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be updated. [ 1108.779067] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b in Status: SUCCESS [ 1108.779274] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce5d9ba7-7740-404a-9bcb-b276b50dbc4b deletion is rescheduled due to dependency. [ 1108.779525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce5d9ba7-7740-404a-9bcb-b276b50dbc4b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.801916] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.802095] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.802172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.802401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.802552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.807597] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7d9a925-c597-44ff-9256-85bc9aa662cd req-e30851c1-0bc2-4f74-9485-df58c7dacc7d tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1108.808890] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1108.809855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.809965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.810053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.810278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.810478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.810581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.810696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.810821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.810905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.811253] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.821668] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: IN_PROGRESS for 2s [ 1108.900543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.900723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.900779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.901019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.901118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.901337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.901453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.901517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.901675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.901752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.901842] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 is going to be updated. [ 1108.934722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.934907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.934978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.935295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.935504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.948119] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: IN_PROGRESS for 2s [ 1108.959450] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.959674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.959788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.960087] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.960355] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.960519] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.960643] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.960974] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.961117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.962428] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.962559] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.962679] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.962795] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.963226] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.963226] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.963226] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.984760] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.984921] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.985085] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.985278] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.985655] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.986442] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.986442] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.986652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.986774] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.992014] env[69350]: INFO networking_nsxv3.common.synchronization [req-cfe4b323-6c3d-46dd-b947-698b381f26b9 req-be1f2030-811d-44b7-9f01-a4736bc8d702 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1108.992223] env[69350]: INFO networking_nsxv3.common.synchronization [req-cfe4b323-6c3d-46dd-b947-698b381f26b9 req-be1f2030-811d-44b7-9f01-a4736bc8d702 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1108.992371] env[69350]: INFO networking_nsxv3.common.synchronization [req-cfe4b323-6c3d-46dd-b947-698b381f26b9 req-be1f2030-811d-44b7-9f01-a4736bc8d702 service nova] Enqueued Resource ID: 09c31512-f51d-45fa-80b9-a29eed026c8d with Priority: HIGHEST for action port [ 1108.993244] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1108.993385] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1108.993483] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09c31512-f51d-45fa-80b9-a29eed026c8d with Priority: HIGHEST for action port [ 1108.993768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.993911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.993950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.994262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.994349] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.995342] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.995492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.995544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.995725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.995959] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.996077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.996165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.996569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.996658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.996754] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.997638] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-09c31512-f51d-45fa-80b9-a29eed026c8d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.997750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.997814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.997975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.998081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c31512-f51d-45fa-80b9-a29eed026c8d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.315752] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.472032] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.472032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.472032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.472032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.472032] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.472718] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.473096] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.473989] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.474471] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.475210] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.475950] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.475950] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.475950] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.476189] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.476328] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.476592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.494838] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.495202] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.495416] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.495851] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.496099] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.496337] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e not found, creating... [ 1109.496743] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.496995] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.497230] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.497594] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.497819] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.499778] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.500061] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.500289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.500633] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.500855] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.501094] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e is going to be created. [ 1109.503684] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.503810] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.504024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.504271] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.504761] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-c2932c71-ed56-489c-a75a-c5925afc8b1c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.505020] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.505213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.505632] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.505847] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2932c71-ed56-489c-a75a-c5925afc8b1c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.507506] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.507625] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.508618] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.509608] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09c31512-f51d-45fa-80b9-a29eed026c8d with status ACTIVE [ 1109.509848] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.509995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.510099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.510359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.510480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.510762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.510907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.511030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.511235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.511365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.511646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.511778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.511890] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.512285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.512285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.512393] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09c31512-f51d-45fa-80b9-a29eed026c8d is going to be updated. [ 1109.535397] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.535781] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.536011] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.536441] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.536806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.537206] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.539293] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.539493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.540156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.540156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.540156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.540431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09c31512-f51d-45fa-80b9-a29eed026c8d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.819092] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.016056] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.017576] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.017958] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.018035] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.018347] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.018532] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.018701] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port c2932c71-ed56-489c-a75a-c5925afc8b1c not found, creating... [ 1110.018987] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.019224] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.019394] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.019641] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.019883] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.020148] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.020328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.020432] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.020721] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.020904] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.020997] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: c2932c71-ed56-489c-a75a-c5925afc8b1c is going to be created. [ 1110.046226] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.046445] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.046601] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.046931] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.047209] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.047470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.322869] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.322869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.322869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.322869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.323256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.323256] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1110.354488] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.354488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.354488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.354488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.354488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.367034] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1110.523942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.524270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.524270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.524416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.524509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.524610] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1110.556952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.556952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.557380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.557775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.558149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.568242] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b06c79e-6d6a-4049-a9f7-f2a0ed6e40db req-c52501d3-37d1-44e6-9baa-76e2ac55b914 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1110.569243] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1110.569913] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.570195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.570395] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.573929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.573929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.573929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.573929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.573929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.573929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.573929] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.573929] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1110.610217] env[69350]: INFO networking_nsxv3.common.synchronization [req-7dff7d62-fd47-4fc3-ac2a-500a1886bd64 req-4fb16193-4f0f-4fe1-b742-519ad5b26740 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 1110.610414] env[69350]: INFO networking_nsxv3.common.synchronization [req-7dff7d62-fd47-4fc3-ac2a-500a1886bd64 req-4fb16193-4f0f-4fe1-b742-519ad5b26740 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1110.610556] env[69350]: INFO networking_nsxv3.common.synchronization [req-7dff7d62-fd47-4fc3-ac2a-500a1886bd64 req-4fb16193-4f0f-4fe1-b742-519ad5b26740 service nova] Enqueued Resource ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with Priority: HIGHEST for action port [ 1110.611196] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 1110.611402] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1110.611650] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with Priority: HIGHEST for action port [ 1110.612313] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.612313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.612313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.613583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.613583] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.613767] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.613878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.613935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.618024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.618024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.618024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.618024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.618024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.831531] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac836d8b-740c-4a34-ae58-041041eb8e77 in Status: SUCCESS [ 1110.831750] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 deletion is rescheduled due to dependency. [ 1110.831841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.875309] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7d9a925-c597-44ff-9256-85bc9aa662cd req-891d4da2-df38-4c71-b7cc-7d99c14d9758 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1110.875610] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7d9a925-c597-44ff-9256-85bc9aa662cd req-891d4da2-df38-4c71-b7cc-7d99c14d9758 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1110.875610] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7d9a925-c597-44ff-9256-85bc9aa662cd req-891d4da2-df38-4c71-b7cc-7d99c14d9758 service nova] Enqueued Resource ID: c2932c71-ed56-489c-a75a-c5925afc8b1c with Priority: HIGHEST for action port [ 1110.875850] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1110.875977] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1110.876783] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2932c71-ed56-489c-a75a-c5925afc8b1c with Priority: HIGHEST for action port [ 1110.877456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.877589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.877659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.877912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.878018] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.878898] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.878999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.879215] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2932c71-ed56-489c-a75a-c5925afc8b1c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.879317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.879385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.879567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.879644] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2932c71-ed56-489c-a75a-c5925afc8b1c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.922519] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.922735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.922893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.923429] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.923756] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.923940] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.924084] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.924408] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.924529] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.924747] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.924897] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.925065] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.925240] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.925365] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.925483] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.925621] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.944679] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.944831] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.944898] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.945110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-107" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.945470] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-507ccafc-7cf4-4261-89c7-b834b8b785d1 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.945901] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.945901] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.946142] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.946323] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507ccafc-7cf4-4261-89c7-b834b8b785d1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.957194] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 in Status: SUCCESS [ 1110.957430] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 deletion is rescheduled due to dependency. [ 1110.957584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.074994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.074994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.074994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.074994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.074994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.076070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.076070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.076070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.076070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.076070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.076070] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1111.107501] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.107501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.107501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.107762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.107762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.118981] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1111.119336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.120336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.120615] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.121485] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with status ACTIVE [ 1111.121668] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.121785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.121852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.122076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.122170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.122357] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.122444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.122507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.122719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.122804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.122983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.123115] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.123168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.123342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.123435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.123548] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e is going to be updated. [ 1111.159357] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.159528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.159570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.159773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.159917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.160096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.382838] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.382838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.383310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2932c71-ed56-489c-a75a-c5925afc8b1c with status ACTIVE [ 1111.383310] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.383416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.383531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.383752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.383902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.384162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.384276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.384360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.384562] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.384697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.385010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.385176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.385253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.385510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.385638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.385765] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2932c71-ed56-489c-a75a-c5925afc8b1c is going to be updated. [ 1111.410052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.410257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.410313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.410500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.410662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.410833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2932c71-ed56-489c-a75a-c5925afc8b1c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.449316] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.449569] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.449773] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.450156] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.450326] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.450488] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 507ccafc-7cf4-4261-89c7-b834b8b785d1 not found, creating... [ 1111.450770] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.450951] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.451093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.451366] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.451513] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.451824] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.452043] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.452140] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.452436] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.452485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.452639] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 507ccafc-7cf4-4261-89c7-b834b8b785d1 is going to be created. [ 1111.476742] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.476742] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.476888] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.479334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.479334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.479334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.626058] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.128376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.131029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.131029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.131029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.131029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.131029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1112.166450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.168739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.168739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.168739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.168739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.176448] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1112.277343] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b06c79e-6d6a-4049-a9f7-f2a0ed6e40db req-c5300152-ee7d-4b5c-af85-445899d4dba9 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1112.277550] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b06c79e-6d6a-4049-a9f7-f2a0ed6e40db req-c5300152-ee7d-4b5c-af85-445899d4dba9 service nova] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1112.277743] env[69350]: INFO networking_nsxv3.common.synchronization [req-9b06c79e-6d6a-4049-a9f7-f2a0ed6e40db req-c5300152-ee7d-4b5c-af85-445899d4dba9 service nova] Enqueued Resource ID: 507ccafc-7cf4-4261-89c7-b834b8b785d1 with Priority: HIGHEST for action port [ 1112.278025] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_rules [ 1112.278206] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1112.278341] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 507ccafc-7cf4-4261-89c7-b834b8b785d1 with Priority: HIGHEST for action port [ 1112.279814] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.279969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.280078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.280603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.280682] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.282176] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.282389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.282630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-507ccafc-7cf4-4261-89c7-b834b8b785d1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.282744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.282813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.283433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.283517] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507ccafc-7cf4-4261-89c7-b834b8b785d1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.376725] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1112.376958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.377540] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.377702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.377936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.378021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.378190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.378237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.378301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.378393] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.582822] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1112.583214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.583257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.583470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.583661] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.583779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.583845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.584011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.584173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.584241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.584329] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.783012] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.783232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.787592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 507ccafc-7cf4-4261-89c7-b834b8b785d1 with status ACTIVE [ 1112.787804] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.787941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.788030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.788257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.788355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.788536] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.788630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.788786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.788840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.788929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.789466] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.789466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.789466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.789466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.789933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.789933] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 507ccafc-7cf4-4261-89c7-b834b8b785d1 is going to be updated. [ 1112.817214] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.817214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.817214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.817214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.817214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.817214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-507ccafc-7cf4-4261-89c7-b834b8b785d1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.880647] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.087432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.087432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.087432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.087432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.087432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.087432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.087813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.087813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.087813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.087893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.088469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.088469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.088469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.088469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.088469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.088756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.088756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.088879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.088970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.089059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.089154] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.136559] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 4s [ 1113.383578] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.594234] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1113.611961] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.612232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.612232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.612410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.612503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.612729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.612825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.612882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.613042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.613134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.613334] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.613430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.613492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.613632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.613705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.613879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.613970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.614318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.614636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.614750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.614846] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1113.683628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.683861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.683947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.684314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.684779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.710435] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1113.887530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.887704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.887787] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.888073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.888147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.888254] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1113.923695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.923853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.923927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.924249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.924408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.936057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1114.188154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.188154] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.188154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.188154] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.692336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.692726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.692778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.693071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.693405] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.693525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.693596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.693784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.693870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.693959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.694140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.694263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.694327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.694486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.694627] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.694724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.694790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.694934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.695071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.695210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.695362] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.147783] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1115.148035] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1115.148177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.148394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.148684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.148896] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.149050] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.149122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.149289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.149367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.149465] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.197436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bcf01dc-147d-49bc-839a-137d73c85e2d: rpc.has_security_group_logging(os_id): False [ 1115.225536] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.225774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.225871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.226268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.226370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.226653] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.226813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.226908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.227279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.227410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.227830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.227919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.228021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.228273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.228401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.228687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.228863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.228959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.229197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.229320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.229455] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1115.306192] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.306192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.306192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.306192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.306192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.323805] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1115.651627] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.728544] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1115.728940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.951120] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1115.951120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.951120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.951120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.951120] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.951518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.951518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.951518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.951596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.951702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.951795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.154262] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.456249] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.456402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.456478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.456705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.456871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.456969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.457043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.457190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.457276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.457362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.457498] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.457589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.457649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.457810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.457968] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.458164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.458241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.458397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.458472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.458553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.458639] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.656513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.656672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.656738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.656951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.657052] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.657150] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1116.687031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.687220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.687292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.687541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.687697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.699366] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1116.961360] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 1116.980835] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.981032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.981142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.981463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.981596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.981929] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.982114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.982179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.982385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.982502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.982872] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.983895] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.983895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.984452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.984452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.984452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1117.079862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.080018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.080094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.080290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.080440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.108509] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1117.279193] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.279379] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1117.339017] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1117.339017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.710189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1118.710671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.710795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.711096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.711423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.711581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.711706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.711934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.712085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.712232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.712380] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.131897] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1119.132227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.214889] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.215101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.215223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.215536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.215882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.215981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.216027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.216244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.216392] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.216523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.216710] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.216850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.217011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.217173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.217376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.217511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.217605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.217805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.218085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.218085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.218184] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.720452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49b616ed-5cd5-4814-a54b-e879de71d218: rpc.has_security_group_logging(os_id): False [ 1119.743378] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.743599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.743599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.743803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.743979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.744294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.745776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.745898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.746232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.746341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.746573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.746810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.746942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.747158] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.747636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.747636] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.747636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.747636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.747958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.747958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.747958] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1119.837478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.837634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.837700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.838034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.838604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.858239] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1121.877921] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1121.878351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.280578] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.280578] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.552590] env[69350]: INFO networking_nsxv3.common.synchronization [req-42ba03e8-a221-474b-86bb-fd53946ab2fc req-691ed11a-a535-4ab3-ae75-016d909a5f5f tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1122.553158] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1122.553546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.553674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.553742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.554026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.554285] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.554413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.554476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.554647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.554725] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.554861] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.882713] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.883096] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.883420] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.883865] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.884248] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.884428] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.884606] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.884928] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.885181] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.885489] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.885760] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.885958] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.886133] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.886304] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.887127] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.887127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.908644] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.908927] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.909091] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.909296] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.909716] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-7f3d236c-7e21-4ca6-983a-9b79e12834d2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.909950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.910110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.910459] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.910727] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3d236c-7e21-4ca6-983a-9b79e12834d2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.056756] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.056948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.057043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.057304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.057405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.057611] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.057789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.057789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.057929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.057992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.058116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 already deleted. [ 1123.058700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.413973] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.413973] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.414290] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.414606] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.414820] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.415055] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 7f3d236c-7e21-4ca6-983a-9b79e12834d2 not found, creating... [ 1123.415386] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.415627] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.415792] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.416079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.416268] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.416598] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.416802] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.416965] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.417237] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.417388] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.417536] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 7f3d236c-7e21-4ca6-983a-9b79e12834d2 is going to be created. [ 1123.440117] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.440444] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.440522] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.440775] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.441036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.441319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.573976] env[69350]: INFO networking_nsxv3.common.synchronization [req-19fd1239-bdaf-4b08-a1de-3d02f54d4615 req-a50dd4bd-edd0-43c1-9527-1322254ee98f tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1124.575017] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1124.575751] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.575751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.575751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.575751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.575966] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.576023] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.576057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.576295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.576295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.576366] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [req-42ba03e8-a221-474b-86bb-fd53946ab2fc req-7d52a853-614b-4aed-a3e1-f307287b2f46 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [req-42ba03e8-a221-474b-86bb-fd53946ab2fc req-7d52a853-614b-4aed-a3e1-f307287b2f46 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [req-42ba03e8-a221-474b-86bb-fd53946ab2fc req-7d52a853-614b-4aed-a3e1-f307287b2f46 service nova] Enqueued Resource ID: 7f3d236c-7e21-4ca6-983a-9b79e12834d2 with Priority: HIGHEST for action port [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1124.687028] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3d236c-7e21-4ca6-983a-9b79e12834d2 with Priority: HIGHEST for action port [ 1124.687880] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.688185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.688252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.688695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.688791] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.690070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.690214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.690286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.690542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.690637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.690734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.690797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.691102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.691248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.691628] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.692449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f3d236c-7e21-4ca6-983a-9b79e12834d2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.692449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.692449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.692611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.692611] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3d236c-7e21-4ca6-983a-9b79e12834d2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.979170] env[69350]: INFO networking_nsxv3.common.synchronization [req-395be13e-9ea6-4d4b-bd05-9d29c1acf8af req-c67b4a4f-4b5a-4750-96be-3b3e7cd18561 tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1124.979809] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1124.980146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.980295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.078959] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.196242] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.196405] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.196533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.196691] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f3d236c-7e21-4ca6-983a-9b79e12834d2 with status ACTIVE [ 1125.196845] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.196942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.197012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.197220] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.197302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.197461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.197546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.197603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.197751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.197822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.197993] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.201080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.201080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.201080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.201080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.201080] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f3d236c-7e21-4ca6-983a-9b79e12834d2 is going to be updated. [ 1125.227196] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.227382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.227429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.227639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.227777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.228285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f3d236c-7e21-4ca6-983a-9b79e12834d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.454788] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.454996] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.455140] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.455413] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.455674] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.455832] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.455954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.456194] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.456346] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.456663] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.456819] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.456993] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.457126] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.457267] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.457407] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.457549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.485088] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.485278] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.485423] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.485603] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.485923] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e583fe9a-8f7b-4437-9f9f-f32727338c9e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.486172] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.486234] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.486568] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.486739] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e583fe9a-8f7b-4437-9f9f-f32727338c9e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.582293] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.703056] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.989630] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.989966] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.990099] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.990330] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.990494] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port e583fe9a-8f7b-4437-9f9f-f32727338c9e not found, creating... [ 1125.991145] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.991145] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.991323] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.992572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.992572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.992572] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.992746] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.992876] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.993128] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.994976] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.994976] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e583fe9a-8f7b-4437-9f9f-f32727338c9e is going to be created. [ 1126.018368] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.018571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.018701] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.018986] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.019252] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.019483] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.085387] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.085560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.085633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.085854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.085946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.086064] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1126.133043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.133043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.133043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.133043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.133043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.159736] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1126.206044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.206044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.206044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.206244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.206651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.206651] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be created. [ 1126.237202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.237202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.237202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.237202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.237202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.247853] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: UNINITIALIZED for 2s [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [req-395be13e-9ea6-4d4b-bd05-9d29c1acf8af req-e5ddc09a-db49-4a6a-9e98-73fa4c9137b8 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [req-395be13e-9ea6-4d4b-bd05-9d29c1acf8af req-e5ddc09a-db49-4a6a-9e98-73fa4c9137b8 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [req-395be13e-9ea6-4d4b-bd05-9d29c1acf8af req-e5ddc09a-db49-4a6a-9e98-73fa4c9137b8 service nova] Enqueued Resource ID: e583fe9a-8f7b-4437-9f9f-f32727338c9e with Priority: HIGHEST for action port [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1126.713594] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583fe9a-8f7b-4437-9f9f-f32727338c9e with Priority: HIGHEST for action port [ 1126.713594] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.713594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.714377] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.714492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.715174] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e583fe9a-8f7b-4437-9f9f-f32727338c9e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.716053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.716053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.716053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.716053] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e583fe9a-8f7b-4437-9f9f-f32727338c9e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.218843] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e583fe9a-8f7b-4437-9f9f-f32727338c9e with status ACTIVE [ 1127.219031] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.219178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.219248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.219480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.219574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.219762] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.219861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.219922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.220116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.220194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.220402] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.220513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.220560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.220713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.220789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.220874] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e583fe9a-8f7b-4437-9f9f-f32727338c9e is going to be updated. [ 1127.257895] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.258103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.258440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.258809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.259090] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.259376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e583fe9a-8f7b-4437-9f9f-f32727338c9e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.170259] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1128.170559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.264338] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1128.264338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.264512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.264761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.264940] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.265060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.265128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.265282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.265357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.265564] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.478906] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.479146] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.479286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.479601] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.479895] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.480100] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.480205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.480422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.480571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.480776] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.481020] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.481020] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.481140] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.481224] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.481345] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.481482] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.500044] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.500178] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.500361] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.500604] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-711" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.501056] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.501299] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.501479] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.501839] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.502048] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.768761] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.004494] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.004699] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.005683] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.005683] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.005683] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.005868] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.005927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.006029] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.006263] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.006435] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.006819] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.006989] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.007139] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.007450] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.007622] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.007776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e is going to be updated. [ 1129.032466] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.032694] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.032809] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.033129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.033380] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.033624] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.274220] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.777366] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.777552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.777619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.777835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.777927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.778060] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1129.815323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.815511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.815683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.815905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.816133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.828129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1129.930916] env[69350]: INFO networking_nsxv3.common.synchronization [req-ab9fca22-33a7-4ecc-8b46-8f8002304790 req-7d919af5-552f-423f-b571-3d56c27d53a0 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 1129.930916] env[69350]: INFO networking_nsxv3.common.synchronization [req-ab9fca22-33a7-4ecc-8b46-8f8002304790 req-7d919af5-552f-423f-b571-3d56c27d53a0 service nova] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1129.930916] env[69350]: INFO networking_nsxv3.common.synchronization [req-ab9fca22-33a7-4ecc-8b46-8f8002304790 req-7d919af5-552f-423f-b571-3d56c27d53a0 service nova] Enqueued Resource ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with Priority: HIGHEST for action port [ 1129.930916] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_rules [ 1129.931351] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1129.931503] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with Priority: HIGHEST for action port [ 1129.931818] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.931949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.932110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.932255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.932355] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.933486] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.933609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.933609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.934131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.934131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.934131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.934131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.934406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.934406] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.934505] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.935422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.935422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.935422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.935655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.935655] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.036574] env[69350]: INFO networking_nsxv3.common.synchronization [req-bcddcc5b-dbf9-4fd2-81fb-7c186d020f9b req-57cd6902-e680-417e-901e-e2d187f95a5c tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1130.037603] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1130.037603] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.037706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.373756] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.374091] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.374129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.374471] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.374751] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.374924] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.375739] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.375739] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.375739] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.375739] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.376096] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.376096] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.376096] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.376235] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.376235] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.376358] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.396153] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.396519] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.397245] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.397245] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-999" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.397748] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-600062e4-759d-4770-a6a0-0e2de74ab63c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.397970] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.398258] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.398832] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.399111] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('600062e4-759d-4770-a6a0-0e2de74ab63c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.437448] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.437591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.437835] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.438827] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e with status ACTIVE [ 1130.438920] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.438981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.440037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.440037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.440037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.440353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.440353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.440353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.440353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.440470] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e is going to be updated. [ 1130.461572] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.461782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.461842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.462135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.462278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.462449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe0a6ff-67e3-4ffa-88fc-8068bb472e6e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.902470] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.902686] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.902795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.903117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.903343] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.903656] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 600062e4-759d-4770-a6a0-0e2de74ab63c not found, creating... [ 1130.903961] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.904163] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.904392] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.904668] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.904837] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.905158] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.905338] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.905457] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.905710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.905859] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.906041] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 600062e4-759d-4770-a6a0-0e2de74ab63c is going to be created. [ 1130.931041] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.931309] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.931448] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.931757] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.932009] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.932259] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.942225] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.445300] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.445634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.445634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.445807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.445903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.446017] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1131.476202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.476668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.476668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.476929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.477031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.490948] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1131.731672] env[69350]: INFO networking_nsxv3.common.synchronization [req-bcddcc5b-dbf9-4fd2-81fb-7c186d020f9b req-ee64c22a-f16d-4c84-b6df-86168f6487f6 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1131.734382] env[69350]: INFO networking_nsxv3.common.synchronization [req-bcddcc5b-dbf9-4fd2-81fb-7c186d020f9b req-ee64c22a-f16d-4c84-b6df-86168f6487f6 service nova] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1131.734799] env[69350]: INFO networking_nsxv3.common.synchronization [req-bcddcc5b-dbf9-4fd2-81fb-7c186d020f9b req-ee64c22a-f16d-4c84-b6df-86168f6487f6 service nova] Enqueued Resource ID: 600062e4-759d-4770-a6a0-0e2de74ab63c with Priority: HIGHEST for action port [ 1131.735765] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_rules [ 1131.736045] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1131.736258] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600062e4-759d-4770-a6a0-0e2de74ab63c with Priority: HIGHEST for action port [ 1131.736722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.736919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.737323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.737493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.738419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-600062e4-759d-4770-a6a0-0e2de74ab63c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.738631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.738766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.739137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.739298] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('600062e4-759d-4770-a6a0-0e2de74ab63c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.841331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1131.841603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.841834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.842103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.842325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.842526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.842573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.842737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.842814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.842977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.843096] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.844143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.844322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.844444] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.844611] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.844684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.844886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.844944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.845012] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.242091] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 600062e4-759d-4770-a6a0-0e2de74ab63c with status ACTIVE [ 1132.242091] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.242091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.242091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.242953] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.242953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.243525] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.243525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.243525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.243698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.243698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.243777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 600062e4-759d-4770-a6a0-0e2de74ab63c is going to be updated. [ 1132.271561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.271815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.271925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.272272] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.272527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.272808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-600062e4-759d-4770-a6a0-0e2de74ab63c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.346584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.346792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.346967] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.849602] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.352844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.353064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.353196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.353684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.353769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.353881] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1133.386763] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.387022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.387092] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.387327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.387506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.398370] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1133.502537] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1133.502866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.503136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.503527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.503791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.503949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.504045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.504238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.504353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.504449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.504500] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.006944] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.007322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.010768] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.012029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.012029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.012029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.012029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.012029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.012273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.012273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.012540] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.012721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.012809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.013541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.013830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.014074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.014310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.014621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.015271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.015271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.015271] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.518105] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bcf01dc-147d-49bc-839a-137d73c85e2d: rpc.has_security_group_logging(os_id): False [ 1134.544865] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.544865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.544865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.545194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.545487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.545531] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.545628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.545748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.545956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.546100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.546359] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.546491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.546588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.546861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.546861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.547179] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.547284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.547314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.547539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.547726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.547833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1134.654217] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.654455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.654533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.654844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.655072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.674811] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1135.411379] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.411379] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.411379] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.411911] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.914355] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.417280] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.694862] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1136.694862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.737424] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1136.737596] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1136.920746] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.920965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.921143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.921511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.921668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.921844] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1136.952599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.952813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.952903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.953313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.953593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.966740] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1138.983549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1138.983549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.983866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.983944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.984173] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.984307] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.984383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.984940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.984940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.984940] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.487891] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.990294] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.423187] env[69350]: INFO networking_nsxv3.common.synchronization [req-2e3eeedc-eb9b-4a99-af76-22db85b75ef4 req-16eb858a-a465-4cfa-a352-05652e0925a8 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1140.423686] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1140.424433] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.424433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.424433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.424433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.424604] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.425116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.425116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.425116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.425116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.425116] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.493420] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.493420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.493569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.493832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.493832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.493923] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1140.525656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.526315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.526315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.526315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.526618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.536917] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1140.929629] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.431591] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.888585] env[69350]: INFO networking_nsxv3.common.synchronization [req-51388ada-9a98-4b2c-8043-da6a6a22599a req-74bc6503-4f13-43da-bc59-f6013466491e tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1141.889221] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGHEST for action security_group_members [ 1141.889626] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.889811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.889811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.890102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.890302] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.891311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.891311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.891311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.891311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.891311] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.934385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.934619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.934619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.934863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.935036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.935161] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1141.977318] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.977538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.977538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.977737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.977920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.987030] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1142.394824] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.395040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.395105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.395354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.418477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.418772] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.418899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.418985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.419183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.419264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.419357] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f is going to be updated. [ 1142.450326] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.450703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.450703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.451149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.451432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.462417] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: IN_PROGRESS for 2s [ 1142.546967] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1142.547294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.547524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.547778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.548052] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.548169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.548268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.548441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.548553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.548666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.548853] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.548983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.549064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.549266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.549444] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.549570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.549684] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.549830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.549939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.550107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.550229] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.052425] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2c1ed42-adff-458a-8288-03bcbb9a7500: rpc.has_security_group_logging(os_id): False [ 1143.072802] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.073044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.073107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.073394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.074074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.074074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.074074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.074335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.074335] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.074433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.074708] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.074840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.074925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.075128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.075227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.075505] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.075706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.075742] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.075921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.076035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.076162] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be created. [ 1143.139848] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.139848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.139848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.139848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.140270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.153507] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1143.755712] env[69350]: INFO networking_nsxv3.common.synchronization [req-666956bd-ac6f-46c8-8937-e6f25bde9d41 req-c3e41509-b666-4336-b62d-93520d9f4724 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1143.755712] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1143.756259] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.756259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.756259] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.756441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.756599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.756751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.756751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.756920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.756970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.757080] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.998486] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1143.998710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.125977] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.126384] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.126473] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.126890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.127296] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.127570] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.127708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.128132] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.128306] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.128537] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.128657] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.128791] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.128986] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.129214] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.129398] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.129489] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.149967] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.150300] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.150477] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.150680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.151181] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-e7710459-b84f-40c5-94f8-dbcd614885bd taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.151393] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.151789] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.152262] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.152474] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7710459-b84f-40c5-94f8-dbcd614885bd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.259481] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.473207] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27c7362-80ef-4c99-9dd6-75361259db7f in Status: SUCCESS [ 1144.473398] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f deletion is rescheduled due to dependency. [ 1144.473580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.655330] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.655571] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.655624] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.656011] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.656227] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.656441] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port e7710459-b84f-40c5-94f8-dbcd614885bd not found, creating... [ 1144.656832] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.657082] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.657372] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.657711] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.658118] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.658505] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.658690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.658933] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.659131] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.659341] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.659524] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: e7710459-b84f-40c5-94f8-dbcd614885bd is going to be created. [ 1144.683393] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.683851] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.684083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.684395] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.684727] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.685099] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.762362] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.168375] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1145.168608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.168782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.169016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.169148] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.264754] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.265008] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.265145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.265425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.265577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.265706] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1145.300238] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.300477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.300477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.300682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.300838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.311549] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1145.659083] env[69350]: INFO networking_nsxv3.common.synchronization [req-666956bd-ac6f-46c8-8937-e6f25bde9d41 req-6e34a545-bdbe-41e9-810c-7f0832efc7b0 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1145.659293] env[69350]: INFO networking_nsxv3.common.synchronization [req-666956bd-ac6f-46c8-8937-e6f25bde9d41 req-6e34a545-bdbe-41e9-810c-7f0832efc7b0 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1145.659439] env[69350]: INFO networking_nsxv3.common.synchronization [req-666956bd-ac6f-46c8-8937-e6f25bde9d41 req-6e34a545-bdbe-41e9-810c-7f0832efc7b0 service nova] Enqueued Resource ID: e7710459-b84f-40c5-94f8-dbcd614885bd with Priority: HIGHEST for action port [ 1145.659996] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1145.660655] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1145.660778] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7710459-b84f-40c5-94f8-dbcd614885bd with Priority: HIGHEST for action port [ 1145.661082] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.661209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.661277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.661484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.661566] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.665024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.665024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.665024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7710459-b84f-40c5-94f8-dbcd614885bd taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.665024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.665024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.665024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.665024] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7710459-b84f-40c5-94f8-dbcd614885bd',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.671205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.671354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.671412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.671633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.671793] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.671892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.672018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.672129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.672604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.672604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.672604] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.168273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.168273] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7710459-b84f-40c5-94f8-dbcd614885bd with status ACTIVE [ 1146.168273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.168273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.168273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.168273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.168953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.168953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.168953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.168953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.168953] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7710459-b84f-40c5-94f8-dbcd614885bd is going to be updated. [ 1146.177517] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.177681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.177722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.177899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.178063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.178154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.178635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.178635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.178635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.178635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.178635] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.178840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.178840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.178918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.179062] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.179155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.179217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.179352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.179427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.179507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.179624] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.198182] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.198402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.198402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.198587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.198728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.198882] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7710459-b84f-40c5-94f8-dbcd614885bd" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.374744] env[69350]: INFO networking_nsxv3.common.synchronization [req-68678cb6-159c-426b-8026-37e7c75751e0 req-ba07e682-64bf-49ae-890f-cbafd7050343 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1146.375336] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1146.375647] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.375804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.375879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.376105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.376269] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.376396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.376437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.376568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.376758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.376758] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.681848] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2c1ed42-adff-458a-8288-03bcbb9a7500: rpc.has_security_group_logging(os_id): False [ 1146.704020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.704020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.704020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.704020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.704632] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.704632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.704632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.704899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.705079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.705264] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1146.770889] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.771289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.771463] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.771794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.772051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.786123] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1146.878905] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.324062] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1147.324515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.324515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.324751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.324957] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.325202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.325291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.325492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.325740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.325740] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.381157] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.828998] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.883459] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.883766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.883863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.884075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.884282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.884424] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1147.917407] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.917759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.917883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.918201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.918436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.929872] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1148.267898] env[69350]: INFO networking_nsxv3.common.synchronization [req-575e0803-2e7e-4180-9b0e-043f71d1ffed req-6c3cbde7-3eef-4b7e-b365-67367d913f72 tempest-AttachVolumeShelveTestJSON-1191619421 tempest-AttachVolumeShelveTestJSON-1191619421-project-member] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1148.268535] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGHEST for action security_group_members [ 1148.268817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.268950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.269892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.270256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.270739] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.270739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.270739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.270981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.271134] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.271270] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.332501] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.776706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.776706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.776706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.776706] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be updated. [ 1148.804949] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1148.804949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.804949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.804949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.804949] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.823283] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.828184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.828184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.828184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.828184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.834436] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.834436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.834584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.836150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.836150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.836150] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1148.839272] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: IN_PROGRESS for 2s [ 1148.865212] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.865366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.865683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.865683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.865899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.875739] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1149.310841] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.310841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.311119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.311711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.311711] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.311711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.311711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.311931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.311931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.311931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.312076] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.815391] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.816019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.816019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.816019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.816232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.816232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.816232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.816409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.816473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.816566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.816714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.816814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.816885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.817055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.817193] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.817287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.817352] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.817505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.817579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.817661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.817767] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.941591] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1149.942057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.320832] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2c1ed42-adff-458a-8288-03bcbb9a7500: rpc.has_security_group_logging(os_id): False [ 1150.338621] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.338829] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.338880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.339078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.339171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.339360] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.339470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.339534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.339810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.339810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.340045] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.340166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.340230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.340378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.340455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.340656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.340750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.340812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.340953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.341040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.341128] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1150.404556] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.404816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.404816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.405022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.405172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.418934] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1150.851463] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 in Status: SUCCESS [ 1150.851870] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 deletion is rescheduled due to dependency. [ 1150.851870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.885277] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1150.885524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.885722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.886464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.886464] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.886464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.886464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.886745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.886745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.886745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.886860] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.388627] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.388854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.388962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.389265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.389451] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.389566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.389631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.389789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.389875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.389996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.390162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.390254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.390309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.390444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.390581] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.390670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.390734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.390870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.390955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.391044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.391139] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.893306] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1151.918237] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.918431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.918471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.918668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.918759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.918976] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.919094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.919142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.919294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.919369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.919559] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.919661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.919697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.919842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.919903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.920097] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.920237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.920237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.920375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.920446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.920534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1151.988026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.988026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.988026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.988026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.988026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.009655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1152.436552] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1152.436795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.270245] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.270741] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1154.032314] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1154.032692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.818787] env[69350]: INFO networking_nsxv3.common.synchronization [req-c2ecd055-eff1-45e0-961c-12eec7cb6465 req-d4ed16fe-49d2-4e12-8778-10c7b1c97184 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1155.819398] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1155.819496] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.819617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.819704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.819889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.820071] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.820169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.820231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.820385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.820473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.820564] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.201491] env[69350]: INFO networking_nsxv3.common.synchronization [req-f5b567da-3082-4352-a2ab-c57a81b0cbca req-b5f9cb78-f685-4d3f-ba7f-656a53e31715 tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1156.202058] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGHEST for action security_group_members [ 1156.202365] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.202492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.202560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.202810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.203140] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.208238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.208334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.208608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.208676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.208799] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.257144] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.257144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.257144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.257144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.257144] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.257144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.257144] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.257519] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.257519] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.257779] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.257936] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.258116] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.258264] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.258409] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.258547] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.258712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.283333] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.283625] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.283804] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.283961] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.284295] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-b8a80a28-8ba8-422d-bada-faf50145b67b taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.284470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.284606] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.284993] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.285166] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a80a28-8ba8-422d-bada-faf50145b67b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.323026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.712719] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.712719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.712719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.712719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.712719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.713117] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.713117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.713224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.713399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.713504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.713723] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be updated. [ 1156.741981] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.741981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.741981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.741981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.741981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.750910] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: IN_PROGRESS for 2s [ 1156.788592] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.788915] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.789078] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.789418] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.789578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.789746] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port b8a80a28-8ba8-422d-bada-faf50145b67b not found, creating... [ 1156.790078] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.790258] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.790379] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.790667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.790892] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.791411] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.791674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.791829] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.792123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.792309] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.792438] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: b8a80a28-8ba8-422d-bada-faf50145b67b is going to be created. [ 1156.815595] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.815890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.815950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.816261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.816504] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.816742] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.825872] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.328130] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.328354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.328354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.328591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.328680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.328783] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1157.379266] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.379266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.379266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.379508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.379753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.399769] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1157.638738] env[69350]: INFO networking_nsxv3.common.synchronization [req-c2ecd055-eff1-45e0-961c-12eec7cb6465 req-0ab8135a-21d9-43f7-b3a5-24758567a2a5 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1157.639065] env[69350]: INFO networking_nsxv3.common.synchronization [req-c2ecd055-eff1-45e0-961c-12eec7cb6465 req-0ab8135a-21d9-43f7-b3a5-24758567a2a5 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1157.639304] env[69350]: INFO networking_nsxv3.common.synchronization [req-c2ecd055-eff1-45e0-961c-12eec7cb6465 req-0ab8135a-21d9-43f7-b3a5-24758567a2a5 service nova] Enqueued Resource ID: b8a80a28-8ba8-422d-bada-faf50145b67b with Priority: HIGHEST for action port [ 1157.640377] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1157.640377] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1157.640377] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a80a28-8ba8-422d-bada-faf50145b67b with Priority: HIGHEST for action port [ 1157.640628] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.640814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.640916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.641165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.641308] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.642354] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.642501] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.642776] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8a80a28-8ba8-422d-bada-faf50145b67b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.642971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.643106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.643336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.643454] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a80a28-8ba8-422d-bada-faf50145b67b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.149910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.149910] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8a80a28-8ba8-422d-bada-faf50145b67b with status ACTIVE [ 1158.149910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.149910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.149910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.149910] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.150638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.150638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.150638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.150638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.150638] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8a80a28-8ba8-422d-bada-faf50145b67b is going to be updated. [ 1158.182310] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.182310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.182310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.182310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.182310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.182310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8a80a28-8ba8-422d-bada-faf50145b67b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.215947] env[69350]: INFO networking_nsxv3.common.synchronization [req-820199fa-4fcf-42a5-a2a3-2163ff750a59 req-b2676350-1c39-442c-a853-e3be57960f6f tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1158.216578] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1158.217283] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.217438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.217438] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.217642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.217811] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.217918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.217981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.218150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.218235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.218330] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.425268] env[69350]: INFO networking_nsxv3.common.synchronization [req-3f7258d1-4a7d-483f-81e5-1de3a8125433 req-f34c7aed-3add-4691-9c9f-912648573db2 tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1158.425597] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1158.425905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.426248] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.426341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.426549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.426718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.426818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.426877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.427035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.427116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.427207] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.651368] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.651368] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.651368] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.651728] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.651728] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.651845] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.651961] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.652206] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.652366] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.652575] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.652696] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.652813] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.652925] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.653052] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.653169] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.653315] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.679277] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.679835] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.680223] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.680509] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.682104] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.682104] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.682104] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.682644] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.682898] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b5cc78f-281f-4aa6-8dd0-261c01e3a807',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.721640] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.721841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.721886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.722166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.763937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.764232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.764357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.764427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.764755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.764818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.764898] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be updated. [ 1158.767172] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 in Status: SUCCESS [ 1158.767393] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 deletion is rescheduled due to dependency. [ 1158.767455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.831435] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.831666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.831711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.831937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.832105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.850129] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 1158.929622] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.186475] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.186892] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.187145] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.187568] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.187801] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.188059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 not found, creating... [ 1159.188585] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.188925] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.189169] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.189578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.189836] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.190364] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.190625] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.190810] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.191189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.191436] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.191714] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 is going to be created. [ 1159.252429] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.253131] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.253131] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.253672] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.254109] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.254514] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.415547] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1159.415918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.416222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.416570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.416867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.417897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.417897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.417897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.417897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.417897] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.435437] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.921540] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.937875] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.938057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.938129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.938340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.938426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.938516] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1159.968914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.970897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.970897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.970897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.970897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.980248] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1160.426302] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.558022] env[69350]: INFO networking_nsxv3.common.synchronization [req-820199fa-4fcf-42a5-a2a3-2163ff750a59 req-6a90735b-e12b-48c1-978a-8015a1c16d86 service nova] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_rules [ 1160.558022] env[69350]: INFO networking_nsxv3.common.synchronization [req-820199fa-4fcf-42a5-a2a3-2163ff750a59 req-6a90735b-e12b-48c1-978a-8015a1c16d86 service nova] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1160.558022] env[69350]: INFO networking_nsxv3.common.synchronization [req-820199fa-4fcf-42a5-a2a3-2163ff750a59 req-6a90735b-e12b-48c1-978a-8015a1c16d86 service nova] Enqueued Resource ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with Priority: HIGHEST for action port [ 1160.558184] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_rules [ 1160.558316] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1160.558416] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with Priority: HIGHEST for action port [ 1160.558939] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.559078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.559139] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.559359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.559438] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.560464] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.560588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.560816] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.560895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.560948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.561135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.561209] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b5cc78f-281f-4aa6-8dd0-261c01e3a807',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.861396] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 1160.862617] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 deletion is rescheduled due to dependency. [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.862617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.862617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.863093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.863093] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.929381] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.929526] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.929604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.929934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.930330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.930330] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1160.958408] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.958707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.958949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.959289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.959497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.969999] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1161.064070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.064070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.064070] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with status ACTIVE [ 1161.064070] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.064070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.064484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.064484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.064484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.064623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.064718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.064806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.065035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.065146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.065370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.065504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.065610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.065811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.065912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.066011] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 is going to be updated. [ 1161.088444] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.088597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.088657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.088881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.089033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.089197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.365595] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.868161] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.990372] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1161.990647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.094592] env[69350]: INFO networking_nsxv3.common.synchronization [req-f1c8ee09-8160-4fc7-a528-f6d721fa1276 req-2d47530b-a687-456d-ba76-5cb0f54f63c3 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1162.095191] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGHEST for action security_group_members [ 1162.095489] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.095610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.095685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.095879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.096045] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.096153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.096217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.096398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.096498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.096636] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.373046] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.373046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.373046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.373046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.373046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.373046] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be updated. [ 1162.414024] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.414024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.414024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.414024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.414024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.427242] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 1162.599539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.599830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.599947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.600303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.600460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.600764] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.600918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.601063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.601318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.601440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.601574] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 is going to be updated. [ 1162.632170] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.632353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.632422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.632782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.632939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.642965] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: IN_PROGRESS for 2s [ 1162.981406] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1162.981856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.981893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.982199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.982346] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.982466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.982525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.982686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.982778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.982849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.982941] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.485559] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.485837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.485837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.487032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.487032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.487514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.487514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.487514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.487514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.487514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487735] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.603109] env[69350]: INFO networking_nsxv3.common.synchronization [req-553654c3-47b2-433c-adb7-914db29e52bf req-935c45af-7697-4382-b6d3-a778f5f483b6 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1163.603691] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1163.604044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.604154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.604199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.604412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.604569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.605262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.605361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.605527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.605614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.605752] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.991022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 1164.008561] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.008692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.008770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.008993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.009104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.009350] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.009425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.009488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.009630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.009705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.009914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.010022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.010083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.010225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.010297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.010679] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.010679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.010679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.010841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.010841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.010902] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1164.069726] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.069937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.069937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.070185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.070343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.087833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1164.108440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.108544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.108613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.109186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.109287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.109504] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.109587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.109651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.109806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.109881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.109968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1164.163908] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.164097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.164170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.164420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.164578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.172733] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1164.440383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 1164.440623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.440930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.441276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.441510] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.441755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.441846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.442035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.442122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.442207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.442301] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.652743] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 in Status: SUCCESS [ 1164.653085] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 deletion is rescheduled due to dependency. [ 1164.653271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.944906] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.944906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.944906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.944906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.945238] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.945238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.945391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.945440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.945652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.945652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.945828] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.945828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.945913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.946075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.946194] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.946281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.946339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.946477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.946549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.946626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.946710] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.449834] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c5d6740-3439-4769-8b56-9e97215cbf77: rpc.has_security_group_logging(os_id): False [ 1165.469672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.469782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.469889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.472029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.472029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.472029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.472029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.472502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.472502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.472502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.472502] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be updated. [ 1165.544099] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.544261] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.544334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.544557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.544701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.558082] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 1165.704550] env[69350]: INFO networking_nsxv3.common.synchronization [req-98895bdc-d133-4f49-ab0b-5114f1d71c4e req-842c2788-e4c4-4b1c-81f7-82c6cb8e53a7 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1165.704550] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1165.704880] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.705011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.705096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.705588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.705588] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.706431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.706431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.706431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.706431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.706431] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.105039] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1166.105327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.182444] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1166.182444] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1166.182444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.210772] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.376137] env[69350]: INFO networking_nsxv3.common.synchronization [None req-eeb698cf-e0f7-49fd-b183-6f373a5d36ab tempest-AttachInterfacesTestJSON-2016432681 tempest-AttachInterfacesTestJSON-2016432681-project-member] Enqueued Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1166.376137] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d with Priority: HIGHEST for action security_group_members [ 1166.376137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bcf01dc-147d-49bc-839a-137d73c85e2d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.376137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.376137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.376137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.376137] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.376137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.376137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.376853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.377061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.377252] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bcf01dc-147d-49bc-839a-137d73c85e2d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.635883] env[69350]: INFO networking_nsxv3.common.synchronization [req-ba08e1d3-0e44-4211-afa7-eaa8d144338e req-dd5435b6-933b-48ba-8657-50545ea04832 tempest-DeleteServersTestJSON-1645452589 tempest-DeleteServersTestJSON-1645452589-project-member] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1166.636438] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGHEST for action security_group_members [ 1166.636744] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.636878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.636992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.640127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.640296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.640402] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.640466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.640631] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.640711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.640800] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.712403] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.882141] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.882141] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.882141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.882141] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d is going to be updated. [ 1166.910877] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.910877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.910877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.910877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.910877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.918440] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: IN_PROGRESS for 2s [ 1167.143440] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.143637] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.143711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.143967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.144079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.144307] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.144410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.144472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.144652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.144731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.144847] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be updated. [ 1167.183032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.183642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.183642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.183642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.183642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.192960] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: IN_PROGRESS for 2s [ 1167.216986] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.216986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.216986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.216986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.216986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.216986] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1167.253656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.254717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.255140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.255489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.255750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.267152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1167.572056] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 1167.572284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.930836] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d in Status: SUCCESS [ 1168.931295] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bcf01dc-147d-49bc-839a-137d73c85e2d deletion is rescheduled due to dependency. [ 1168.931295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bcf01dc-147d-49bc-839a-137d73c85e2d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.206263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49b616ed-5cd5-4814-a54b-e879de71d218 in Status: SUCCESS [ 1169.206451] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 deletion is rescheduled due to dependency. [ 1169.206508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.278045] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1169.278293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.576785] env[69350]: INFO networking_nsxv3.common.synchronization [req-57b8564b-2b24-48bd-b607-014d2038841b req-4015a8e0-a1d4-4650-89f3-633ffd323b77 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1169.577384] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1169.578147] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.578278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.578336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.578543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.578722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.578807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.578884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.580054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.580054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.580054] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.069121] env[69350]: INFO networking_nsxv3.common.synchronization [req-0f7a95ab-6c2a-455f-bc73-9d059c7d7ff8 req-4626190e-570f-4932-a476-958e1bd21b2c tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1170.069121] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGHEST for action security_group_members [ 1170.069121] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.069121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.069121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.069738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.069738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.069738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.069738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.069738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.069889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.069889] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.085017] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.114462] env[69350]: INFO networking_nsxv3.common.synchronization [req-0f7a95ab-6c2a-455f-bc73-9d059c7d7ff8 req-4626190e-570f-4932-a476-958e1bd21b2c tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with Priority: HIGHEST for action port [ 1170.114943] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with Priority: HIGHEST for action port [ 1170.115267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.115387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.115524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.115645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.115725] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b5cc78f-281f-4aa6-8dd0-261c01e3a807',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.572217] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.572430] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.572479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.572733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.572851] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.572982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.573106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.573171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.573327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.573404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.573493] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be updated. [ 1170.586907] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.608093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.608257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.608333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.608563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.608711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.618015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 with status ACTIVE [ 1170.618291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.618456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.618519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.618710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.618798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.619037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.619104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.619135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.619288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.619363] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.619543] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.619641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.619698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.619840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.619914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.620000] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b5cc78f-281f-4aa6-8dd0-261c01e3a807 is going to be updated. [ 1170.623966] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: IN_PROGRESS for 2s [ 1170.642687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.642687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.643063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.643063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.643149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.643313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b5cc78f-281f-4aa6-8dd0-261c01e3a807" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.090417] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.090714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.090714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.091541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.091541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.091541] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1171.123748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.124119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.124119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.124389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.124603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.135495] env[69350]: INFO networking_nsxv3.common.synchronization [req-7d6cee18-3c1c-4128-85cd-da6e1a7887b4 req-e55e34f2-c0d7-4da0-94b7-1380f2558976 tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1171.137192] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1171.137847] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1171.138093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.138372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.138372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.138516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.138754] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.138883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.138938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.139120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.139205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.139321] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.466300] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.466300] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.466300] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.468771] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.469798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.471365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.471365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.471365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.471365] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.471365] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.471365] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.471365] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.471365] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.471365] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.472066] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.472066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.493811] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.493971] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.494043] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.495032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-779" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.495032] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-eb99080c-08a7-4daa-9422-b4f337dc5666 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.495032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.495250] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.495414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.495552] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb99080c-08a7-4daa-9422-b4f337dc5666',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.559938] env[69350]: INFO networking_nsxv3.common.synchronization [None req-d4a3f222-d106-4ecf-83c7-f95e6ef0909e None None] Enqueued Resource ID: 34517425-e527-4133-a34e-974247878034 with Priority: HIGHEST for action port [ 1171.560224] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34517425-e527-4133-a34e-974247878034 with Priority: HIGHEST for action port [ 1171.560799] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-34517425-e527-4133-a34e-974247878034 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.560950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34517425-e527-4133-a34e-974247878034" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.561171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34517425-e527-4133-a34e-974247878034" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.561284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34517425-e527-4133-a34e-974247878034" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.561364] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34517425-e527-4133-a34e-974247878034',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.642821] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.643073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.643145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.643368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.643581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.643652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.643796] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.643891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.644035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.644172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.644263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1171.685263] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.685263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.685263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.685447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.686979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.695117] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1171.803093] env[69350]: INFO networking_nsxv3.common.synchronization [req-b9891f17-25b9-4043-97e5-17f2d19423f0 req-fa18c827-7d10-4c51-ac1a-2a64d71b5044 tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1171.803363] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1171.803705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.803822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.803913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.804825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.805038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.805107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.805165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.805330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.805411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.805508] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.999340] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.999340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.999340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.999340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.999340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.999340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port eb99080c-08a7-4daa-9422-b4f337dc5666 not found, creating... [ 1171.999700] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.999700] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.999797] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.000041] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.000177] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.000472] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.000600] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.000713] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.000927] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.004065] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.005580] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: eb99080c-08a7-4daa-9422-b4f337dc5666 is going to be created. [ 1172.027890] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.027890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.028175] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.028237] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.028513] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.028784] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.070884] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34517425-e527-4133-a34e-974247878034 [ 1172.070884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.070884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.070884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.071242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.071366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.071502] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34517425-e527-4133-a34e-974247878034 already deleted. [ 1172.071626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34517425-e527-4133-a34e-974247878034" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.308091] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.507230] env[69350]: INFO networking_nsxv3.common.synchronization [None req-60849602-6d39-4c10-ac2c-1a6618e8cb9e tempest-ServersTestBootFromVolume-1875583275 tempest-ServersTestBootFromVolume-1875583275-project-member] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1172.507230] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1172.507230] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.507230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.507230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.507230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.507230] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.635839] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 in Status: SUCCESS [ 1172.635839] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 deletion is rescheduled due to dependency. [ 1172.635839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.666017] env[69350]: INFO networking_nsxv3.common.synchronization [None req-6c75bffe-9889-4e00-8ac9-c1b7dd03a265 tempest-ServersTestBootFromVolume-1875583275 tempest-ServersTestBootFromVolume-1875583275-project-member] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1172.666017] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1172.666017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.666017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.812593] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.868402] env[69350]: INFO networking_nsxv3.common.synchronization [req-7d6cee18-3c1c-4128-85cd-da6e1a7887b4 req-c1cc3b3a-e175-46f2-adff-5bacf4e05c38 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1172.868585] env[69350]: INFO networking_nsxv3.common.synchronization [req-7d6cee18-3c1c-4128-85cd-da6e1a7887b4 req-c1cc3b3a-e175-46f2-adff-5bacf4e05c38 service nova] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1172.868737] env[69350]: INFO networking_nsxv3.common.synchronization [req-7d6cee18-3c1c-4128-85cd-da6e1a7887b4 req-c1cc3b3a-e175-46f2-adff-5bacf4e05c38 service nova] Enqueued Resource ID: eb99080c-08a7-4daa-9422-b4f337dc5666 with Priority: HIGHEST for action port [ 1172.869021] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_rules [ 1172.870924] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1172.870924] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99080c-08a7-4daa-9422-b4f337dc5666 with Priority: HIGHEST for action port [ 1172.871138] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.871193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.871230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.871522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.871602] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.872721] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.872721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.873082] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb99080c-08a7-4daa-9422-b4f337dc5666 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.873190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.874976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.874976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.874976] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb99080c-08a7-4daa-9422-b4f337dc5666',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.033513] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.033513] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 already deleted. [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.033513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.033513] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.147937] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1173.147937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.315464] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.315719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.315719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.316049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.316117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.316189] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1173.353102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.353228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.353293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.353511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.353663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.363072] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1173.376654] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.376798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.377116] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb99080c-08a7-4daa-9422-b4f337dc5666 with status ACTIVE [ 1173.377190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.377313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.377399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.377615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.377705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.377881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.377981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.378054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.378221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.378299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.378478] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.378573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.378635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.378839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.378928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.379027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb99080c-08a7-4daa-9422-b4f337dc5666 is going to be updated. [ 1173.410044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.410458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.410458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.410779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.410779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.410943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb99080c-08a7-4daa-9422-b4f337dc5666" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.576253] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.576502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.576638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.578648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.578648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.578648] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 already deleted. [ 1173.578648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.707117] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1173.707305] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1173.707422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.707583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.707800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.707985] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.708118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.708186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.708344] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.708422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.708519] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.901311] env[69350]: INFO networking_nsxv3.common.synchronization [None req-69ba1c38-351e-4d1a-8930-d4904fe66ef3 None None] Enqueued Resource ID: e3f60160-75bf-4d63-bea7-3136768c75d2 with Priority: HIGHEST for action port [ 1173.901717] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f60160-75bf-4d63-bea7-3136768c75d2 with Priority: HIGHEST for action port [ 1173.902152] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f60160-75bf-4d63-bea7-3136768c75d2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.902378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f60160-75bf-4d63-bea7-3136768c75d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.902554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f60160-75bf-4d63-bea7-3136768c75d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.902939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f60160-75bf-4d63-bea7-3136768c75d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.903092] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f60160-75bf-4d63-bea7-3136768c75d2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.211049] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.405314] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3f60160-75bf-4d63-bea7-3136768c75d2 [ 1174.405897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.405897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.405897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.406029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.406029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.408314] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3f60160-75bf-4d63-bea7-3136768c75d2 already deleted. [ 1174.408314] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f60160-75bf-4d63-bea7-3136768c75d2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.713408] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.216921] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.216921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.218042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.218042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.218042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.218042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1175.252419] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.252711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.252774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.253038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.253202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.364170] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1175.389127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1175.389479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.974020] env[69350]: INFO networking_nsxv3.common.synchronization [req-b9a78667-bba2-4248-a58d-8ac66a72ab09 req-b38e8de0-51b0-40a9-b133-2507367fe8e7 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1176.974020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1176.974020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.974020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.974020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.974020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.974020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.974608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.974608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.974608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.974608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.974608] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.373686] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1177.373988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.374214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.374449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.374646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.374767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.374834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.375040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.375148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.375240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.375331] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.476648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.476889] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.476951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.477278] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.477416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.477654] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.477811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.477888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.478194] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.478301] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.478408] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1177.518108] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.518312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.518365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.518636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.518844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.531473] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1177.877356] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.877549] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.877610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.878106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.878106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.878454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.878545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.878634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.878792] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.879113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.879254] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.879343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.879419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.879591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.879669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.879755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.879847] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.382715] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f77ff482-c36b-41a0-9c84-caa4cc51cf3d: rpc.has_security_group_logging(os_id): False [ 1178.402159] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.402356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.402489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.402978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.403183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.404135] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.404295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.404342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.404729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.404834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.405040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.405150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.405224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.405388] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.405465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.405698] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.405786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.405846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.406049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.406096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.406161] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1178.477134] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.477380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.477476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.477762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.477945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.493920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1179.541318] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1179.541757] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1179.541757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.507026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1180.507808] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.884511] env[69350]: INFO networking_nsxv3.common.synchronization [req-39997bed-657b-4dbb-8d53-175c29534942 req-62b0d234-146f-4bd7-8cb9-3eaf98a2938f tempest-ListServerFiltersTestJSON-516067063 tempest-ListServerFiltersTestJSON-516067063-project-member] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1180.885319] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGHEST for action security_group_members [ 1180.886398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.886398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.886398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.886398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.886398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.886695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.886695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.886899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.886951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.887050] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.389830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.390036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.390109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.390334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.390429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.390634] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.390723] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.390781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.390937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.391013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.391091] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be updated. [ 1181.419544] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.419759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.419822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.420063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.420209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.430263] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: IN_PROGRESS for 2s [ 1183.313431] env[69350]: INFO networking_nsxv3.common.synchronization [req-eac4839c-694d-41d3-85be-eb3367ff9f7b req-e294a717-3e7e-42c0-880b-51761a0f5178 tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1183.314023] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1183.315640] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.315769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.315837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.316062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.316375] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.316375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.316375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.316524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.316588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.316684] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.447015] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 in Status: SUCCESS [ 1183.447015] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 deletion is rescheduled due to dependency. [ 1183.447015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.752469] env[69350]: INFO networking_nsxv3.common.synchronization [None req-1d5780ac-e849-4476-a7c2-5d1c7fe71183 None None] Enqueued Resource ID: d86d1d86-d805-47a6-b381-f18dd78656c2 with Priority: HIGHEST for action port [ 1183.753042] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d86d1d86-d805-47a6-b381-f18dd78656c2 with Priority: HIGHEST for action port [ 1183.753369] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d86d1d86-d805-47a6-b381-f18dd78656c2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.753509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d86d1d86-d805-47a6-b381-f18dd78656c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.753577] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d86d1d86-d805-47a6-b381-f18dd78656c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.753901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d86d1d86-d805-47a6-b381-f18dd78656c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.753974] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d86d1d86-d805-47a6-b381-f18dd78656c2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.819092] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.819270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.819345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.819576] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.819671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.819884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.819986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.820080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.820244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.820323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.820415] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1183.862324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.862590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.862590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.864228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.864228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.873751] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1184.070120] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.070376] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.070526] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.070825] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.071179] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.071370] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.071495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.074112] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.074299] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.074528] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.074648] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.074764] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.074896] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.075082] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.075255] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.075431] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.097430] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.098879] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.099017] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.099219] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-229" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.099564] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-fb53c94a-43b1-4847-84fd-bc187a61dd5b taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.099759] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.099898] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.100285] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.100445] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb53c94a-43b1-4847-84fd-bc187a61dd5b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.257410] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d86d1d86-d805-47a6-b381-f18dd78656c2 [ 1184.257680] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.257860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.257958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.258213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.258337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.258452] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d86d1d86-d805-47a6-b381-f18dd78656c2 already deleted. [ 1184.258550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d86d1d86-d805-47a6-b381-f18dd78656c2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.604798] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.604798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.604798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.605333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.605333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.605441] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port fb53c94a-43b1-4847-84fd-bc187a61dd5b not found, creating... [ 1184.605618] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.605782] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.605913] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.606212] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.606400] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.606744] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.606951] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.607123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.608342] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.608342] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.608342] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: fb53c94a-43b1-4847-84fd-bc187a61dd5b is going to be created. [ 1184.632540] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.632540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.632540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.632540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.632540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.632540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.500476] env[69350]: INFO networking_nsxv3.common.synchronization [req-eac4839c-694d-41d3-85be-eb3367ff9f7b req-a21e0f40-9ae8-4fff-8e16-47304ad3ccd2 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1185.500476] env[69350]: INFO networking_nsxv3.common.synchronization [req-eac4839c-694d-41d3-85be-eb3367ff9f7b req-a21e0f40-9ae8-4fff-8e16-47304ad3ccd2 service nova] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1185.500476] env[69350]: INFO networking_nsxv3.common.synchronization [req-eac4839c-694d-41d3-85be-eb3367ff9f7b req-a21e0f40-9ae8-4fff-8e16-47304ad3ccd2 service nova] Enqueued Resource ID: fb53c94a-43b1-4847-84fd-bc187a61dd5b with Priority: HIGHEST for action port [ 1185.500476] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_rules [ 1185.500817] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1185.501061] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb53c94a-43b1-4847-84fd-bc187a61dd5b with Priority: HIGHEST for action port [ 1185.501586] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.501715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.501870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.502033] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.502138] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.503844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.503844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.503844] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb53c94a-43b1-4847-84fd-bc187a61dd5b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.503844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.503844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.503844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.503844] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb53c94a-43b1-4847-84fd-bc187a61dd5b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.559415] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b584fb8-3020-400c-a1cc-8d5ede92fb97 req-c853f09b-acc9-4416-8baa-f7ca4bac1ff8 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1185.559897] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1185.560488] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.560650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.560726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.560932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.561101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.561229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.561293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.561447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.561533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.561728] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.783086] env[69350]: INFO networking_nsxv3.common.synchronization [None req-7551ef4c-1928-4ce9-9336-467bf0ef317e None None] Enqueued Resource ID: 058a1ed3-011d-4440-bdb5-24f6f2e2f887 with Priority: HIGHEST for action port [ 1185.783753] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058a1ed3-011d-4440-bdb5-24f6f2e2f887 with Priority: HIGHEST for action port [ 1185.784211] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-058a1ed3-011d-4440-bdb5-24f6f2e2f887 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.784355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-058a1ed3-011d-4440-bdb5-24f6f2e2f887" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.784447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-058a1ed3-011d-4440-bdb5-24f6f2e2f887" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.784715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-058a1ed3-011d-4440-bdb5-24f6f2e2f887" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.784963] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058a1ed3-011d-4440-bdb5-24f6f2e2f887',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.885143] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1185.885417] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1185.885467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.885670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.885899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.886114] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.886303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.886394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.886557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.886643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.886845] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.984374] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.984578] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.984742] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.985085] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.985357] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.985697] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.985697] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.985882] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.986043] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.986257] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.986375] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.986487] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.986595] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.986765] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.986897] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.987046] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.005158] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.005280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.005482] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb53c94a-43b1-4847-84fd-bc187a61dd5b with status ACTIVE [ 1186.005648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.005752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.005860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.006025] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.006120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.006309] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.006409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.006470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.006642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.006758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.006884] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.006977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.007049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.007187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.007256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.007338] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb53c94a-43b1-4847-84fd-bc187a61dd5b is going to be updated. [ 1186.009695] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.009844] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.009954] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.010141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-293" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.010415] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.010574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.010696] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.010992] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.011303] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29b8f7a2-3a55-4b29-96e3-cdea4cc0943e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.035224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.035440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.035538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.035824] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.035972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.036188] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb53c94a-43b1-4847-84fd-bc187a61dd5b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.063445] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.287291] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 058a1ed3-011d-4440-bdb5-24f6f2e2f887 [ 1186.287291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.287546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.287546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.287784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.287930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.288082] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:058a1ed3-011d-4440-bdb5-24f6f2e2f887 already deleted. [ 1186.288153] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-058a1ed3-011d-4440-bdb5-24f6f2e2f887" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.388961] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.513950] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.514277] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.514420] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.514706] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.514868] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.515071] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e not found, creating... [ 1186.515348] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.517703] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.517703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.517703] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e is going to be created. [ 1186.541465] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.541465] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.541465] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.541685] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.541875] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.542137] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.566450] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.892578] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.070398] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.070558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.070630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.070861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.070954] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.071093] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1187.099026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.099231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.099282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.099464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.099607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.109063] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1187.255736] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b584fb8-3020-400c-a1cc-8d5ede92fb97 req-3f65222b-2f6c-40d3-99a7-5919ca295e88 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1187.255939] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b584fb8-3020-400c-a1cc-8d5ede92fb97 req-3f65222b-2f6c-40d3-99a7-5919ca295e88 service nova] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1187.256109] env[69350]: INFO networking_nsxv3.common.synchronization [req-3b584fb8-3020-400c-a1cc-8d5ede92fb97 req-3f65222b-2f6c-40d3-99a7-5919ca295e88 service nova] Enqueued Resource ID: 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e with Priority: HIGHEST for action port [ 1187.256378] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_rules [ 1187.256551] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1187.256619] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e with Priority: HIGHEST for action port [ 1187.257241] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.257370] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.257454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.257640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.257715] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.258591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.258681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.258888] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.258988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.259151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.259235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.259300] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29b8f7a2-3a55-4b29-96e3-cdea4cc0943e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.395252] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.395462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.396287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.396287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.396287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.396287] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1187.428290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.429125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.429125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.429623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.429623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.440191] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1187.490960] env[69350]: INFO networking_nsxv3.common.synchronization [req-fca03ca2-49af-4ea0-9152-3923261bbfa3 req-a1c54973-07e5-4a5f-b8c3-3795f0bfaeae tempest-ServerDiskConfigTestJSON-1904154100 tempest-ServerDiskConfigTestJSON-1904154100-project-member] Enqueued Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1187.491318] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d with Priority: HIGHEST for action security_group_members [ 1187.491696] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.491816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.495026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.495026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.495026] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f77ff482-c36b-41a0-9c84-caa4cc51cf3d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.762558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.762779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.762970] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e with status ACTIVE [ 1187.763221] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.763356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.763456] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.763729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.763891] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.764151] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.764276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.764337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.764531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.764612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.764848] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.764907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.764951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.765212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.765212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.765301] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29b8f7a2-3a55-4b29-96e3-cdea4cc0943e is going to be updated. [ 1187.791278] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.791429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.791552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.791734] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.791904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.792091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29b8f7a2-3a55-4b29-96e3-cdea4cc0943e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.994883] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.995523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.995523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.995523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.995523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.995663] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.995663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.995746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.995864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.995940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.996066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d is going to be updated. [ 1188.023597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.023749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.023814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.024122] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.024265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.032943] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: IN_PROGRESS for 2s [ 1189.122625] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 4s [ 1189.462331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1189.462429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.462626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.462815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.463042] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.463168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.463311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.463382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.463470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.463610] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.463681] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.966054] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.966223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.966298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.966536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.966706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.966807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.966866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.967119] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.967229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.967294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.967445] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.967538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.967596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.967737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.967874] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.967966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.968037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.968184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.968266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.968347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.968434] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.044764] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d in Status: SUCCESS [ 1190.045127] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f77ff482-c36b-41a0-9c84-caa4cc51cf3d deletion is rescheduled due to dependency. [ 1190.045362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f77ff482-c36b-41a0-9c84-caa4cc51cf3d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.470751] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7: rpc.has_security_group_logging(os_id): False [ 1190.488648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.488789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.488839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.489051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.489151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.489370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.489472] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.489535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.489687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.489763] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.489962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.490066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.490124] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.490263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.492291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.492291] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.492291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.492291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.492291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.492291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.492291] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1190.577932] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.577932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.577932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.577932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.577932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.588925] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1191.136310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1191.136573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.136804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.137114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.137307] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.137442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.137504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.137665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.137747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.138083] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.640942] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.143218] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.492408] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.492554] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1192.605606] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1192.605846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.646656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.647015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.647015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.647195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.647468] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.647595] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1192.677384] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.677550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.677615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.677836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.677980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.689102] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1193.613107] env[69350]: INFO networking_nsxv3.common.synchronization [req-a1d8ec9a-d756-4a2d-a11b-e646f8611cbf req-db9739a9-558e-4fa5-bb73-84fb15bab494 tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1193.613620] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1193.613810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.614543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.614543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.617977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.617977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.617977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.617977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.617977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.617977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.617977] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.090037] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.090037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.090037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.090037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.090552] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.090552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.090552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.090665] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.090894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.091022] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.091138] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.091252] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.091363] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.091474] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.091580] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.091771] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.115680] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.115859] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.116017] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.116214] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.116583] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-54f4adc3-54fb-4d19-8e40-d32b0955f28c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.116795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.116930] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.117411] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.117582] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f4adc3-54fb-4d19-8e40-d32b0955f28c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.120110] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.120228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.120283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.120466] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.120552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.120729] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.120822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.120881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.121035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.121109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.121190] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 already deleted. [ 1194.121266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.620186] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.620491] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.620621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.620923] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.621098] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.621261] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 54f4adc3-54fb-4d19-8e40-d32b0955f28c not found, creating... [ 1194.621527] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.621704] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.621798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.622039] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.622183] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.622465] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.622621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.622740] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.622975] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.623135] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.623302] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 54f4adc3-54fb-4d19-8e40-d32b0955f28c is going to be created. [ 1194.645471] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.645687] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.645816] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.646131] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.646381] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.646608] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.698694] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1194.698932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.699136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.699369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.699565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.699685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.699746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.699903] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.700915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.700915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.700915] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.206422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.206422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.206422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.206422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.206422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.207129] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.209704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.209704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.209704] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.209704] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.415299] env[69350]: INFO networking_nsxv3.common.synchronization [req-a1d8ec9a-d756-4a2d-a11b-e646f8611cbf req-2867782a-7fd7-4264-b6c8-cf366ac33a5c service nova] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_rules [ 1195.415636] env[69350]: INFO networking_nsxv3.common.synchronization [req-a1d8ec9a-d756-4a2d-a11b-e646f8611cbf req-2867782a-7fd7-4264-b6c8-cf366ac33a5c service nova] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1195.415878] env[69350]: INFO networking_nsxv3.common.synchronization [req-a1d8ec9a-d756-4a2d-a11b-e646f8611cbf req-2867782a-7fd7-4264-b6c8-cf366ac33a5c service nova] Enqueued Resource ID: 54f4adc3-54fb-4d19-8e40-d32b0955f28c with Priority: HIGHEST for action port [ 1195.418531] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_rules [ 1195.419340] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1195.419340] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f4adc3-54fb-4d19-8e40-d32b0955f28c with Priority: HIGHEST for action port [ 1195.419340] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.419599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.419599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.419946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.420163] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.421250] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.421414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.421514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.421773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.421976] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.422143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.422305] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.422608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.422737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.422872] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.424110] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f4adc3-54fb-4d19-8e40-d32b0955f28c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.424110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.424271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.424390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.424502] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f4adc3-54fb-4d19-8e40-d32b0955f28c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.711305] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42630d9-6f58-45c4-a768-a81a12bdfa43: rpc.has_security_group_logging(os_id): False [ 1195.729528] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.729696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.729754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.729965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.730073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.730296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.730410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.730457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.730905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.730905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.730905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.731059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.731059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.731125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.731214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.731396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.731490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.731551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.731688] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.731761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.732031] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1195.807597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.807774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.807817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.808041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.808207] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.819614] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1195.927314] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.927498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.927686] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f4adc3-54fb-4d19-8e40-d32b0955f28c with status ACTIVE [ 1195.927862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.927968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.928048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.928894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.928894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.928894] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.928894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.928894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.928894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.929193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.929324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.929426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.929567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.929649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.929726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.929813] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f4adc3-54fb-4d19-8e40-d32b0955f28c is going to be updated. [ 1195.930956] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.933461] env[69350]: INFO networking_nsxv3.common.synchronization [req-36c7b976-0a00-434a-8154-2fe110122e59 req-7c669e4b-9bbc-4c99-b37f-327bdd9a1262 tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1195.934810] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1195.935697] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.935697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.968161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.968161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.968161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.968161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.968161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.968161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f4adc3-54fb-4d19-8e40-d32b0955f28c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.278559] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.278967] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.278967] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.279324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.279617] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.279841] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.279998] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.280301] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.280488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.280747] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.280943] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.281111] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.281251] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.281436] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.281579] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.281771] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.318386] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.318386] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.318586] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.318984] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.319460] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-22e6f876-493a-4145-8c3e-de0e5a54d559 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.319761] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.319907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.320407] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.320628] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22e6f876-493a-4145-8c3e-de0e5a54d559',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.433798] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.823330] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.823610] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.823747] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.824121] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.824348] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.824534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 22e6f876-493a-4145-8c3e-de0e5a54d559 not found, creating... [ 1196.824802] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.824965] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.825207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.825502] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.825688] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.826121] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.826449] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.826611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.826950] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.827235] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.827475] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 22e6f876-493a-4145-8c3e-de0e5a54d559 is going to be created. [ 1196.850482] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.850854] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.851083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.851504] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.851874] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.852255] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.936700] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.936910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.936960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.937221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.937322] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.937430] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be created. [ 1196.997155] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.997155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.997155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.997155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.997155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.012554] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: UNINITIALIZED for 2s [ 1197.551572] env[69350]: INFO networking_nsxv3.common.synchronization [req-36c7b976-0a00-434a-8154-2fe110122e59 req-e8593985-1089-485c-a694-4ad715f66723 service nova] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_rules [ 1197.551834] env[69350]: INFO networking_nsxv3.common.synchronization [req-36c7b976-0a00-434a-8154-2fe110122e59 req-e8593985-1089-485c-a694-4ad715f66723 service nova] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1197.551955] env[69350]: INFO networking_nsxv3.common.synchronization [req-36c7b976-0a00-434a-8154-2fe110122e59 req-e8593985-1089-485c-a694-4ad715f66723 service nova] Enqueued Resource ID: 22e6f876-493a-4145-8c3e-de0e5a54d559 with Priority: HIGHEST for action port [ 1197.552962] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_rules [ 1197.552962] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1197.552962] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22e6f876-493a-4145-8c3e-de0e5a54d559 with Priority: HIGHEST for action port [ 1197.552962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.553244] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.553244] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.553318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.553467] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-22e6f876-493a-4145-8c3e-de0e5a54d559 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.553572] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.553621] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.553811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.553891] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22e6f876-493a-4145-8c3e-de0e5a54d559',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.835958] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1197.836224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.056409] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22e6f876-493a-4145-8c3e-de0e5a54d559 with status ACTIVE [ 1198.056652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.056788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.056861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.057103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.057199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.057382] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.057483] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.057546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.057699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.057777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.057958] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.058065] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.058130] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.058267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.058346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.058420] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22e6f876-493a-4145-8c3e-de0e5a54d559 is going to be updated. [ 1198.102686] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.102836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.102905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.103142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.103284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.103445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22e6f876-493a-4145-8c3e-de0e5a54d559" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.032968] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1199.033376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.033376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.033622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.033817] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.033937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.033999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.034263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.034347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.034435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.034533] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.035393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.035566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.035717] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.035823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.035887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.036048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.036127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.036214] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.538736] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.539018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.539324] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.042324] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.486179] env[69350]: INFO networking_nsxv3.common.synchronization [req-7def3c3f-911a-42b5-9c4f-d924fc54a4f7 req-236e5827-7a31-42a0-b37b-25474131d90c tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1200.486726] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1200.487614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.489020] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.489020] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.489020] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.547383] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.547383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.547383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.547383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.547383] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.547383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be updated. [ 1200.575753] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.575959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.576048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.576271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.576441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.587712] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1200.931825] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.932310] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.932310] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.932453] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.932699] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.932864] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.932985] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.933229] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.933382] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.933670] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.933729] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.933819] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.933930] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.934100] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.934197] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.934340] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.968505] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.968505] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.968505] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.968505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-370" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.968505] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.968505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.968505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.968505] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.968505] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.995080] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.232288] env[69350]: INFO networking_nsxv3.common.synchronization [req-c80050f9-281d-44e6-a965-68e7230f1880 req-fbe9b0b7-941c-41af-aff6-4b3e07bd854f tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1201.232288] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1201.232288] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.232992] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.233270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.233756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.234205] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.234492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.234686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.234969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.235197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.235420] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.476119] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.476119] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.476119] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.476394] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.476667] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.476741] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 not found, creating... [ 1201.477088] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.477348] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.477518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.477826] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.478039] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.478597] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.478840] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.478938] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.479345] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.479488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.479754] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 is going to be created. [ 1201.499109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.507851] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.510485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.510485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.510485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.510485] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.511275] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.523831] env[69350]: INFO networking_nsxv3.common.synchronization [req-fecac460-e78b-4150-8571-8a49d39271e5 req-ec7eca39-d32c-485b-a6ed-bb630d2d86a8 tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1201.524857] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1201.525575] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.525575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.525773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.525825] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.525984] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.526101] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.526164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.526316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.526431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.526540] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.739037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.739197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.739197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.739467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.771608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.771608] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.771608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.771608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.771960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.772196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.772388] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1201.803526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.803692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.803785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.804155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.804318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.816147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1202.001774] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.002063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.002063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.002285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.002455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.002610] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1202.029233] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.033465] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.033739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.033739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.034010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.034140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.048919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [req-7def3c3f-911a-42b5-9c4f-d924fc54a4f7 req-1535c9b9-a1e8-488e-90a6-e442776630a0 service nova] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [req-7def3c3f-911a-42b5-9c4f-d924fc54a4f7 req-1535c9b9-a1e8-488e-90a6-e442776630a0 service nova] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [req-7def3c3f-911a-42b5-9c4f-d924fc54a4f7 req-1535c9b9-a1e8-488e-90a6-e442776630a0 service nova] Enqueued Resource ID: 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 with Priority: HIGHEST for action port [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_rules [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1202.278555] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 with Priority: HIGHEST for action port [ 1202.278555] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.279421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.279773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.280143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.280394] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.281771] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.284059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.284059] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.284059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.284059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.284059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.284059] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.536420] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.598292] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1202.598292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.598391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.598747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.599242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.599242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.599242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.599242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.599645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.599645] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.618525] env[69350]: INFO networking_nsxv3.common.synchronization [req-f8b83ab2-b07c-404b-a669-043af1bf731d req-9cc5fa7a-7610-4080-876e-926e8847fdfb tempest-ServersTestBootFromVolume-1875583275 tempest-ServersTestBootFromVolume-1875583275-project-member] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1202.619235] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1202.619617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.619784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.619861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.620157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.620316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.620417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.620482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.620644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.620754] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.620857] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.785797] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.786024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.786106] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 with status ACTIVE [ 1202.786279] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.786382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.786447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.786657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.786776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.786923] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.786990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.787064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.787214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.787289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.787457] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.787548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.787607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.787740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.787810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.787892] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38 is going to be updated. [ 1202.811458] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.811614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.811682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.811894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.812055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.812219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a1bd719-31ae-4fd6-a4be-f8aeaf1f2e38" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.979910] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.980138] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-499" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.980328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-499" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.980621] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-499" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.980893] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.982036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.982036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.982036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.982036] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.982036] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.982282] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.982317] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.982553] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.982553] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.982643] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.982770] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.013289] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.013289] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.013289] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.013289] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-499" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.013571] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-08cc9038-f52d-451c-bee7-5ad27b427dc2 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.013798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.013933] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.014414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.014603] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cc9038-f52d-451c-bee7-5ad27b427dc2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.039329] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.039871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.039871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.039942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.040037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.040237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1203.076566] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.076566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.076566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.076566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.076566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.085569] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1203.102146] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.123115] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.123277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.123337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.123558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.123649] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.123912] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.124328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.124407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.124578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.124650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.124744] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 already deleted. [ 1203.124823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.517312] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.517754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.517754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.518385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.518385] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.518385] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 08cc9038-f52d-451c-bee7-5ad27b427dc2 not found, creating... [ 1203.518611] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.518780] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.518913] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.519484] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.519635] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.519933] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.520123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.520234] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.520463] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.520595] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.520738] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 08cc9038-f52d-451c-bee7-5ad27b427dc2 is going to be created. [ 1203.546235] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.546482] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.546618] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.546953] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.547206] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.547462] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.606467] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.825769] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1203.825769] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 deletion is rescheduled due to dependency. [ 1203.825769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.075432] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1204.075670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.075845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.076082] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.076278] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.076460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.076460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.076817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.076817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.076817] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.106624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.106819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.106858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.107235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.107372] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.107510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be updated. [ 1204.158511] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.158705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.158748] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.158958] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.159140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.168276] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1204.312334] env[69350]: INFO networking_nsxv3.common.synchronization [req-f8b83ab2-b07c-404b-a669-043af1bf731d req-d9343b98-2db9-46ee-be3e-6960fab60993 service nova] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1204.312729] env[69350]: INFO networking_nsxv3.common.synchronization [req-f8b83ab2-b07c-404b-a669-043af1bf731d req-d9343b98-2db9-46ee-be3e-6960fab60993 service nova] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1204.313032] env[69350]: INFO networking_nsxv3.common.synchronization [req-f8b83ab2-b07c-404b-a669-043af1bf731d req-d9343b98-2db9-46ee-be3e-6960fab60993 service nova] Enqueued Resource ID: 08cc9038-f52d-451c-bee7-5ad27b427dc2 with Priority: HIGHEST for action port [ 1204.314377] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_rules [ 1204.314645] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1204.314866] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08cc9038-f52d-451c-bee7-5ad27b427dc2 with Priority: HIGHEST for action port [ 1204.315336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.315573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.315634] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.315876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.315967] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.318157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.318157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.318341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.318518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.318685] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.318826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.318916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.319151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.319268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.319398] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.320518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-08cc9038-f52d-451c-bee7-5ad27b427dc2 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.320669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.320749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.320956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.321077] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cc9038-f52d-451c-bee7-5ad27b427dc2',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.579139] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.818705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.818951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.823028] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.825276] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08cc9038-f52d-451c-bee7-5ad27b427dc2 with status ACTIVE [ 1204.825571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.825760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.825868] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.826341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.826341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.827166] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.827166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.827166] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.827340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.827397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.827706] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.827875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.828120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.828263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.828397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.828544] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08cc9038-f52d-451c-bee7-5ad27b427dc2 is going to be updated. [ 1204.851870] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.851870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.852179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.852179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.852969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.852969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08cc9038-f52d-451c-bee7-5ad27b427dc2" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.082279] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.096374] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1205.096696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.325751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.585055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.585055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.585617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.585617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.585617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.585617] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1205.618614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.618814] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.618865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.619053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.619198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.629188] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1205.828202] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.828365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.828437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.828675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.828767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.828884] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 is going to be created. [ 1205.857777] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.858026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.858026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.858179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.858369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.868974] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: UNINITIALIZED for 2s [ 1206.177731] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1206.177963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.178149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.178412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.178544] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.178663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.178746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.178871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.178950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.179045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.179197] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.179293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.179354] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.179486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.179620] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.179714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.179773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.179901] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.179974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.180068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.180156] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.686034] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0d278d1-7f84-49c8-97b0-0922016d1fd0: rpc.has_security_group_logging(os_id): False [ 1206.708715] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.708976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.708976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.709192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.709287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.709514] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.709617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.709677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.709866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.709959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.710518] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.710518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.710518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.710518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.710518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.710941] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.710941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.710941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.710941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.711155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.711155] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be created. [ 1206.739972] env[69350]: INFO networking_nsxv3.common.synchronization [req-89de504b-c3f7-49ca-8d38-b35bcab591d1 req-733b32aa-e171-406c-b6ed-a4bd24ee36ce tempest-ImagesTestJSON-1454786912 tempest-ImagesTestJSON-1454786912-project-member] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1206.740555] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGHEST for action security_group_members [ 1206.740863] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.740988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.741060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.742059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.742236] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.742350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.742412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.742588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.742673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.742770] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.787971] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.788160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.788241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.788491] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.788657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.802538] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1207.245623] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.245900] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.246030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.246270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.246368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.246583] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.246676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.246794] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.246905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.246986] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.247083] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be updated. [ 1207.282072] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.282072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.282072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.282384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.282420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.293026] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: IN_PROGRESS for 2s [ 1207.653038] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1207.653038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.653293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.653411] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.653661] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.653934] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.654071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.654296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.655027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.655027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.655027] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.883863] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: SUCCESS [ 1207.884308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.884535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.884735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.885834] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.885834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.885834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.885834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.885834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.885834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.885834] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.157143] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.390729] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.661074] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f159146-6707-4314-98f2-9023803a47fc: rpc.has_security_group_logging(os_id): False [ 1208.684111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.684324] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.684365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.684635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.684695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.684972] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.685093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.685151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.685405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.685478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.685568] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1208.754305] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.754529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.754600] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.754836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.755015] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.783078] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1208.836017] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1208.836435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.836596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.836833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.836924] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.893508] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6: rpc.has_security_group_logging(os_id): False [ 1208.956432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.956632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.956798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.957048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.957199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.957539] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.957680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.957735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.957899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.957983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.958139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 is going to be created. [ 1209.091053] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.091317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.091317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.091603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.091792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.111172] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: IN_PROGRESS for 2s [ 1209.321454] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 in Status: SUCCESS [ 1209.321730] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 deletion is rescheduled due to dependency. [ 1209.322081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.339412] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.339588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.339717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.339911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.340105] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.340205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.340285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.340539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.340872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.341075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.341132] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.844036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.844036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.844036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.844376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.844456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.844560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.844624] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.844775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.844862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.844950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.845125] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.845215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.845283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.845431] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.845565] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.845658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.845717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.845854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.845930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.846036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.846129] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.348941] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0d278d1-7f84-49c8-97b0-0922016d1fd0: rpc.has_security_group_logging(os_id): False [ 1210.367786] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.367975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.367975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.368208] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.368304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.368530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.368633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.368698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.368852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.368931] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.369129] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.369225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.369289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.369433] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.369507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.369682] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.369776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.369837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.369973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.370058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.370145] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be updated. [ 1210.435452] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.435689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.435689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.435922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.436093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.449553] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1210.800084] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1210.801145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.123766] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: SUCCESS [ 1211.124240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.717683] env[69350]: INFO networking_nsxv3.common.synchronization [req-27163906-715e-4cee-a770-f114b492da6c req-5c10b89a-1642-47da-85f6-b4cfd2b93f91 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1211.719028] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1211.719028] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.720014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.720140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.720390] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.721096] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.721291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.724303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.724415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.724453] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.724562] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.229271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.229271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.229271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.229271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.257027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.257027] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.257027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.257027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.257027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.257027] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.257027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1212.292724] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.293164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.293385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.293729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.294386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.307370] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1212.465351] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1212.465351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.872766] env[69350]: INFO networking_nsxv3.common.synchronization [req-e1d94db9-2938-4112-a96b-ecba31c45fa0 req-912f79eb-b78d-4e89-b8f2-9b8d9c1c6b3c tempest-ServersTestJSON-1530281689 tempest-ServersTestJSON-1530281689-project-member] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1213.876497] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGHEST for action security_group_members [ 1213.876497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.876497] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.876497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.876497] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.320115] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1214.320346] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 deletion is rescheduled due to dependency. [ 1214.320403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.379073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.379260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.379341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.379579] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.379671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.379914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.380021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.380059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.380183] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.380257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.380346] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be updated. [ 1214.437708] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.437919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.437969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.438177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.438385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.448250] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: IN_PROGRESS for 2s [ 1216.459328] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 in Status: SUCCESS [ 1216.459729] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 deletion is rescheduled due to dependency. [ 1216.459729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.881025] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6a7bb42-da7f-43d1-bfa5-6ee9341a5aa6 req-21ffc4f2-e763-4db1-bab4-6881b32d7602 tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1217.881533] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1217.881838] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.881972] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.882064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.882270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.882424] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.882524] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.882587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.882908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.882908] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.882908] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.263079] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.264161] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.264161] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.264161] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.264161] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.264424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.264424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.264566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.264785] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.265065] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1218.265217] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.265371] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.265535] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.265776] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1218.265776] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.265908] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.287108] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.287303] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1218.287453] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.287717] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.287953] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-adc909a4-5827-430c-a00e-f1013bf25bd0 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.288141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.288263] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.288604] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.288747] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc909a4-5827-430c-a00e-f1013bf25bd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.385573] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.385739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.385816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.387121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.387250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.387431] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.387875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.387875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.387875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.387875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.388074] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1218.420375] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.420535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.420596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.420813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.420991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.435837] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1218.791610] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.791905] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.792064] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.792459] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.792670] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.792912] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port adc909a4-5827-430c-a00e-f1013bf25bd0 not found, creating... [ 1218.793309] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.793539] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.793708] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.794189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.794423] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.794842] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.795088] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.795261] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.795552] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.795741] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.795935] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: adc909a4-5827-430c-a00e-f1013bf25bd0 is going to be created. [ 1218.820739] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.820994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.821314] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.821415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.821665] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.821905] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.708551] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6a7bb42-da7f-43d1-bfa5-6ee9341a5aa6 req-7accc347-b4da-4699-9518-c4e2717e8f6f service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1219.708858] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6a7bb42-da7f-43d1-bfa5-6ee9341a5aa6 req-7accc347-b4da-4699-9518-c4e2717e8f6f service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1219.708920] env[69350]: INFO networking_nsxv3.common.synchronization [req-f6a7bb42-da7f-43d1-bfa5-6ee9341a5aa6 req-7accc347-b4da-4699-9518-c4e2717e8f6f service nova] Enqueued Resource ID: adc909a4-5827-430c-a00e-f1013bf25bd0 with Priority: HIGHEST for action port [ 1219.709497] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1219.709638] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1219.709736] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adc909a4-5827-430c-a00e-f1013bf25bd0 with Priority: HIGHEST for action port [ 1219.715208] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.715479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.715574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.717519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.717609] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.718625] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.718730] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.718935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-adc909a4-5827-430c-a00e-f1013bf25bd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.719049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.719109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.719304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.719412] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc909a4-5827-430c-a00e-f1013bf25bd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.133432] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9ec52da3-0622-41d9-87e3-fe80520014d8 None None] Enqueued Resource ID: 47ebad9a-a893-44ad-8688-57da975f7b94 with Priority: HIGHEST for action port [ 1220.133432] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ebad9a-a893-44ad-8688-57da975f7b94 with Priority: HIGHEST for action port [ 1220.133432] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-47ebad9a-a893-44ad-8688-57da975f7b94 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.133432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47ebad9a-a893-44ad-8688-57da975f7b94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.133432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47ebad9a-a893-44ad-8688-57da975f7b94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.133432] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47ebad9a-a893-44ad-8688-57da975f7b94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.133432] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ebad9a-a893-44ad-8688-57da975f7b94',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.224290] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adc909a4-5827-430c-a00e-f1013bf25bd0 with status ACTIVE [ 1220.224290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.224290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.224290] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.224290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.224290] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adc909a4-5827-430c-a00e-f1013bf25bd0 is going to be updated. [ 1220.228546] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.228546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.250585] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.250806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.250806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.251375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.252229] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.252498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adc909a4-5827-430c-a00e-f1013bf25bd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.450777] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1220.450777] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 deletion is rescheduled due to dependency. [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.450777] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.450777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.451242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.451242] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.638758] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47ebad9a-a893-44ad-8688-57da975f7b94 [ 1220.638978] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.639163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.639216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.639687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.639687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.639687] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47ebad9a-a893-44ad-8688-57da975f7b94 already deleted. [ 1220.639687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47ebad9a-a893-44ad-8688-57da975f7b94" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.955408] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.458577] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.961224] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.961224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.961224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.961582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.961582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.961582] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1222.022037] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.022281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.022281] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.022813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.022813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.035195] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1222.338475] env[69350]: INFO networking_nsxv3.common.synchronization [None req-38395129-2601-40f5-92af-5f1da484a174 None None] Enqueued Resource ID: f48b264c-d9ba-4027-a80b-2ff7909bf366 with Priority: HIGHEST for action port [ 1222.338991] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48b264c-d9ba-4027-a80b-2ff7909bf366 with Priority: HIGHEST for action port [ 1222.339484] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48b264c-d9ba-4027-a80b-2ff7909bf366 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.339606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48b264c-d9ba-4027-a80b-2ff7909bf366" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.339606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48b264c-d9ba-4027-a80b-2ff7909bf366" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.339918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48b264c-d9ba-4027-a80b-2ff7909bf366" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.340267] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48b264c-d9ba-4027-a80b-2ff7909bf366',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.845705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48b264c-d9ba-4027-a80b-2ff7909bf366 [ 1222.845705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.845705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.845705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.845705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.845705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.845705] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48b264c-d9ba-4027-a80b-2ff7909bf366 already deleted. [ 1222.845705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48b264c-d9ba-4027-a80b-2ff7909bf366" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.853786] env[69350]: INFO networking_nsxv3.common.synchronization [None req-408921f6-8b0e-4279-bafe-2c47022bce41 None None] Enqueued Resource ID: 6bee821e-c424-4766-9644-22c1c477cd17 with Priority: HIGHEST for action port [ 1222.854749] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bee821e-c424-4766-9644-22c1c477cd17 with Priority: HIGHEST for action port [ 1222.854749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bee821e-c424-4766-9644-22c1c477cd17 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.854973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bee821e-c424-4766-9644-22c1c477cd17" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.854973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bee821e-c424-4766-9644-22c1c477cd17" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.856276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bee821e-c424-4766-9644-22c1c477cd17" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.856276] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bee821e-c424-4766-9644-22c1c477cd17',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.357521] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bee821e-c424-4766-9644-22c1c477cd17 [ 1223.358146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.358146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.358146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.358308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.358474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.358474] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bee821e-c424-4766-9644-22c1c477cd17 already deleted. [ 1223.358770] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bee821e-c424-4766-9644-22c1c477cd17" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.051139] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1224.051399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.051588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.051731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.051947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.052097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.052160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.052581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.052846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.052846] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.053013] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.319709] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7653bba-64d9-4b79-af3f-f7c741aac166 req-6a7cfcfa-41df-4d66-aaec-009dfd8657c4 tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1224.321098] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1224.321098] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.321323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.321323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.322128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.322128] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.323170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.323170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.323170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.323170] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.323170] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.559973] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.756091] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.756405] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.756566] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.756976] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.757886] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.758285] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.759032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.759032] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.759274] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.759613] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.759862] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.760158] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.760413] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.761085] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.761085] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.761085] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.785740] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.785997] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.786097] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.786351] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.786762] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-71954c89-4416-4f49-9416-3fb168a18829 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.787037] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.787180] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.787559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.787658] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71954c89-4416-4f49-9416-3fb168a18829',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.825351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.825620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.825698] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.825943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.826046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.826250] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.826347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.826410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.826590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.826682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.826789] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1224.874867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.874984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.875068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.875574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.875775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.886824] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1225.061102] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baf89025-1b14-46a4-b655-853662f51662: rpc.has_security_group_logging(os_id): False [ 1225.091532] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.091720] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.091786] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.091966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.092075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.092336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.092440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.092494] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.092632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.092706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.092793] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1225.192348] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.192348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.192348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.192348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.192348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.212774] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1225.294980] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.295361] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.295534] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.295928] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.296126] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.296313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 71954c89-4416-4f49-9416-3fb168a18829 not found, creating... [ 1225.296606] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.296804] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.296929] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.297222] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.297394] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.299489] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.300093] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.300280] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.300572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.300750] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.300948] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 71954c89-4416-4f49-9416-3fb168a18829 is going to be created. [ 1225.308609] env[69350]: INFO networking_nsxv3.common.synchronization [None req-f6c893d1-ab93-49d0-a949-2e9340bf15d4 None None] Enqueued Resource ID: eb3c20cb-e5cd-44ae-aff7-486cee4152a1 with Priority: HIGHEST for action port [ 1225.309901] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb3c20cb-e5cd-44ae-aff7-486cee4152a1 with Priority: HIGHEST for action port [ 1225.310487] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb3c20cb-e5cd-44ae-aff7-486cee4152a1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.310487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb3c20cb-e5cd-44ae-aff7-486cee4152a1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.310650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb3c20cb-e5cd-44ae-aff7-486cee4152a1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.310828] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb3c20cb-e5cd-44ae-aff7-486cee4152a1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.310934] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb3c20cb-e5cd-44ae-aff7-486cee4152a1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.332024] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.332024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.332024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.332024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.332024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.332024] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.814449] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb3c20cb-e5cd-44ae-aff7-486cee4152a1 [ 1225.814866] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.814968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.814968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.816037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.816037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.816037] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb3c20cb-e5cd-44ae-aff7-486cee4152a1 already deleted. [ 1225.816037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb3c20cb-e5cd-44ae-aff7-486cee4152a1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.058361] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7653bba-64d9-4b79-af3f-f7c741aac166 req-5bc36820-7fe3-42b9-802a-c41f95c4b116 service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 1226.058600] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7653bba-64d9-4b79-af3f-f7c741aac166 req-5bc36820-7fe3-42b9-802a-c41f95c4b116 service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1226.058751] env[69350]: INFO networking_nsxv3.common.synchronization [req-c7653bba-64d9-4b79-af3f-f7c741aac166 req-5bc36820-7fe3-42b9-802a-c41f95c4b116 service nova] Enqueued Resource ID: 71954c89-4416-4f49-9416-3fb168a18829 with Priority: HIGHEST for action port [ 1226.058988] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 1226.059142] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1226.059259] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71954c89-4416-4f49-9416-3fb168a18829 with Priority: HIGHEST for action port [ 1226.059832] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.059962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.060644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.060968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.061109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.062695] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.062695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.063323] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-71954c89-4416-4f49-9416-3fb168a18829 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.063523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.063640] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.063918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.064066] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71954c89-4416-4f49-9416-3fb168a18829',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.563881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.563881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.566415] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71954c89-4416-4f49-9416-3fb168a18829 with status ACTIVE [ 1226.566516] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.566630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.566722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.567128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.567128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.567257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.567340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.567497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.567536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.567607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.567791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.567884] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.567938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.568089] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.568169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.568244] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71954c89-4416-4f49-9416-3fb168a18829 is going to be updated. [ 1226.591683] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.591913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.591913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.592264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.592343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.592499] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71954c89-4416-4f49-9416-3fb168a18829" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.899567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1226.900698] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 deletion is rescheduled due to dependency. [ 1226.900827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.901079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.901238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.901430] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.901551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.902482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.902482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.902482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.902482] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.228838] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1227.229070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.404990] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.908566] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.412208] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.412439] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.412573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.412894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.413018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.413135] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1228.460747] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.461022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.461022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.461215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.461398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.471320] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1229.623274] env[69350]: INFO networking_nsxv3.common.synchronization [req-6c8d1b4d-c197-4603-8bc4-020949b7530d req-faf63c25-132a-4eeb-9442-c52ed2a9f258 tempest-ServersNegativeTestMultiTenantJSON-2078007418 tempest-ServersNegativeTestMultiTenantJSON-2078007418-project-member] Enqueued Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1229.623790] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1229.624113] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.624257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.624332] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.624616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.624771] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.624872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.624927] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.625413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.625413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.625413] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.974032] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.974325] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-241" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.974640] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-241" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.975137] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-241" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.975981] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.976221] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.979025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.979025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.979025] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.979025] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1229.979025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1229.979025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1229.979025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.979025] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1229.979025] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.979025] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.001154] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.001419] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.001648] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.001939] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-241" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.002408] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6fc49386-f6a6-4810-9c56-a8d43969e555 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.002671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.002894] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.003312] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.003465] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc49386-f6a6-4810-9c56-a8d43969e555',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.128041] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.128343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.128343] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.128689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.128689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.129149] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.129149] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.129294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.129364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.129447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.129537] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc already deleted. [ 1230.129619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.485321] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.485321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.485321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.485321] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.509021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.509021] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6fc49386-f6a6-4810-9c56-a8d43969e555 not found, creating... [ 1230.509021] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.509021] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.509497] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.509497] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.509497] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.509497] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.509497] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.509497] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6fc49386-f6a6-4810-9c56-a8d43969e555 is going to be created. [ 1230.535072] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.535340] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.535499] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.535833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.536114] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.536596] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.990537] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.293787] env[69350]: INFO networking_nsxv3.common.synchronization [req-6c8d1b4d-c197-4603-8bc4-020949b7530d req-3521f58e-8e89-4ebb-8719-e042b9aec3b1 service nova] Enqueued Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_rules [ 1231.293979] env[69350]: INFO networking_nsxv3.common.synchronization [req-6c8d1b4d-c197-4603-8bc4-020949b7530d req-3521f58e-8e89-4ebb-8719-e042b9aec3b1 service nova] Enqueued Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1231.294143] env[69350]: INFO networking_nsxv3.common.synchronization [req-6c8d1b4d-c197-4603-8bc4-020949b7530d req-3521f58e-8e89-4ebb-8719-e042b9aec3b1 service nova] Enqueued Resource ID: 6fc49386-f6a6-4810-9c56-a8d43969e555 with Priority: HIGHEST for action port [ 1231.295052] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_rules [ 1231.295052] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1231.295052] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fc49386-f6a6-4810-9c56-a8d43969e555 with Priority: HIGHEST for action port [ 1231.295791] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.295791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.295919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.296161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.298666] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.298666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.298666] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.298666] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.299079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.299079] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.299973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fc49386-f6a6-4810-9c56-a8d43969e555 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.300478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.300573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.300807] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.300893] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc49386-f6a6-4810-9c56-a8d43969e555',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.491044] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 935f66d0-48ab-44a6-9d44-d9c84d53af88: rpc.has_security_group_logging(os_id): False [ 1231.514749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.514984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.515047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.515347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.515457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.515771] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.515967] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.516030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.516204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.516304] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.516432] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1231.591633] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.591862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.591862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.592079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.592232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.604551] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1231.802932] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.807036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.807036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fc49386-f6a6-4810-9c56-a8d43969e555 with status ACTIVE [ 1231.807036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.807036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.807036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.807036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.807622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.807622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.807622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.807622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.807622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fc49386-f6a6-4810-9c56-a8d43969e555 is going to be updated. [ 1231.833640] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.833913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.833913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.834151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.834300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.834495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fc49386-f6a6-4810-9c56-a8d43969e555" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.308249] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.810624] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.810827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.810923] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.811235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.811341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.811454] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc is going to be created. [ 1232.838861] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.839048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.839096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.839302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.839560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.849841] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: UNINITIALIZED for 2s [ 1233.214218] env[69350]: INFO networking_nsxv3.common.synchronization [None req-55614a83-4c81-448d-9335-74675bbd7e18 tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1233.214711] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1233.215508] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.215675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.215744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.216105] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.216105] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.296944] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b37f8114-a71b-4dd2-83ff-b12d3a3527b0 tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1233.296944] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1233.298093] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.298531] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.619014] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1233.619375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.740015] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.740252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.742876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.742876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.742876] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.743076] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc already deleted. [ 1233.743076] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.743159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.743326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.743408] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.262854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.263154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.263154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.263570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.263570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.263570] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc already deleted. [ 1234.263570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.864200] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: SUCCESS [ 1234.864200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.864200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.864822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.864822] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.864822] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.865693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.865693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.865693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.865693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.865693] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.367533] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.367775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.367775] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.368118] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.368118] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.368471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.368471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.368471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.368471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.368935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.368935] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.368935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.368935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.369250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.369250] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.369250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.369250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.369441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.369441] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.369553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.369610] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.873666] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3546ebe1-f03c-4c52-959d-58ac3a2927bc: rpc.has_security_group_logging(os_id): False [ 1235.903043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.903214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.903287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.903513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.903609] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.903846] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.903951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.904034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.904198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.904297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.904522] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.904620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.904705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.904845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.904921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.905131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.905219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.905291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.905462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.905548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.905627] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc is going to be created. [ 1236.005177] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.005478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.005478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.005733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.005780] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.021338] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: IN_PROGRESS for 2s [ 1238.037959] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: SUCCESS [ 1238.038348] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.297917] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1238.298121] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1239.415059] env[69350]: INFO networking_nsxv3.common.synchronization [req-b961d955-8f51-4eb3-b0ed-c4d26f21c9df req-220a4b39-c442-415b-8a8f-f9dc2fa35a64 tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1239.415503] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1239.415864] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.419081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.419224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.419522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.419702] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.419815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.419880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.420146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.420215] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.420316] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.744192] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.744402] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.744556] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.744868] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.745141] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.745303] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.745425] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.745674] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.745829] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.747024] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.747024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.747024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.747024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.747024] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.747024] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.747024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.767068] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.767246] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1239.767390] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.767574] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-371" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.767895] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-d8fde81d-4c13-487c-828a-5a3164764411 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.768079] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.768200] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.768525] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.768699] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fde81d-4c13-487c-828a-5a3164764411',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.924080] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.924397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.924445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.924816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.924943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.925209] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.925360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.925428] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.925614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.925713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.925802] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc already deleted. [ 1239.925897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.270935] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.271477] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.271645] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.271944] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.272150] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.272328] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port d8fde81d-4c13-487c-828a-5a3164764411 not found, creating... [ 1240.272618] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.272787] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.272907] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.273155] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.273299] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.273633] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.273825] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.273948] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.274186] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.274328] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.274527] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: d8fde81d-4c13-487c-828a-5a3164764411 is going to be created. [ 1240.295139] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.295375] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.295520] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.296031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.296141] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.296488] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [req-b961d955-8f51-4eb3-b0ed-c4d26f21c9df req-70272ece-511f-4bc7-a5b1-b921be18fe5e service nova] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [req-b961d955-8f51-4eb3-b0ed-c4d26f21c9df req-70272ece-511f-4bc7-a5b1-b921be18fe5e service nova] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [req-b961d955-8f51-4eb3-b0ed-c4d26f21c9df req-70272ece-511f-4bc7-a5b1-b921be18fe5e service nova] Enqueued Resource ID: d8fde81d-4c13-487c-828a-5a3164764411 with Priority: HIGHEST for action port [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_rules [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1241.048180] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fde81d-4c13-487c-828a-5a3164764411 with Priority: HIGHEST for action port [ 1241.048711] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.048711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.048711] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.048812] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.048840] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.051373] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.051373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.051373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.051373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.051373] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.051373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.051373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.051642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.051917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.051917] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.053099] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fde81d-4c13-487c-828a-5a3164764411 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.053225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.053264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.053535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.053650] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fde81d-4c13-487c-828a-5a3164764411',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.550648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.550813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.554231] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.555231] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8fde81d-4c13-487c-828a-5a3164764411 with status ACTIVE [ 1241.555442] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.556161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.556161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.556161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.556161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.556161] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.556375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.556375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.556454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.556581] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.556709] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.556847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.556905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.557035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.557114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.557199] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8fde81d-4c13-487c-828a-5a3164764411 is going to be updated. [ 1241.580015] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.580246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.580246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.580516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.580671] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.580841] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fde81d-4c13-487c-828a-5a3164764411" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.059767] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.562406] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.562651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.562651] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.562898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.563011] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.563152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc is going to be created. [ 1242.587294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.587520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.587520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.587710] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.587877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.598316] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: UNINITIALIZED for 2s [ 1243.732351] env[69350]: INFO networking_nsxv3.common.synchronization [req-0c44c050-fb33-4a18-aa3b-556ed00aa917 req-6e6cfc3b-4ace-4565-9435-6e0f21d45829 tempest-ServersNegativeTestMultiTenantJSON-2078007418 tempest-ServersNegativeTestMultiTenantJSON-2078007418-project-member] Enqueued Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1243.732351] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGHEST for action security_group_members [ 1243.732351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.732351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.732351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.732351] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.238905] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.239228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.239310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.239546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.239647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.239867] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.239975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.240048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.240211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.240288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.240378] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc is going to be updated. [ 1244.271390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.271612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.271612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.271840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.271980] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.280816] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: IN_PROGRESS for 2s [ 1244.609736] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: SUCCESS [ 1244.609918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.610145] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.610413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.610638] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.610782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.610857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.611116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.611221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.611333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.611442] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.113970] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.616814] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 081c1f78-eea5-4d74-9bbb-1632062d2cbc: rpc.has_security_group_logging(os_id): False [ 1245.633998] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.634213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.634260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.634458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.634636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.635237] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.635237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.635237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.635237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.635454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.635454] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc is going to be created. [ 1245.693656] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.693878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.693878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.694116] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.694303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.705237] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: IN_PROGRESS for 2s [ 1246.291566] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc in Status: SUCCESS [ 1246.291566] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc deletion is rescheduled due to dependency. [ 1246.291566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.719043] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: SUCCESS [ 1247.719409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.732117] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.732117] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1253.733208] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.733479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1256.267063] env[69350]: INFO networking_nsxv3.common.synchronization [req-f45c62f5-9723-43e8-be80-294d35950f50 req-839b8202-e9b1-42a4-b92b-3f111fbae75b tempest-ServersTestBootFromVolume-1875583275 tempest-ServersTestBootFromVolume-1875583275-project-member] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1256.267607] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGHEST for action security_group_members [ 1256.267917] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.268054] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.268131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.268879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.268879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.268879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.268879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.268879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.268879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.269291] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.772040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.772040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.772040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.772040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.772040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.772040] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.772040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.772460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.772460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.772460] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.772587] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 is going to be updated. [ 1256.805121] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.805333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.805333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.805546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.805856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.814617] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: IN_PROGRESS for 2s [ 1258.827649] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 in Status: SUCCESS [ 1258.828030] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 deletion is rescheduled due to dependency. [ 1258.828030] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.269059] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.269484] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.270350] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.270875] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.271902] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1271.272220] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1273.684168] env[69350]: INFO networking_nsxv3.common.synchronization [req-b46e8eee-c092-4639-8a18-184edd3ebc9b req-b7bbac27-5e1b-4196-aaed-9861f81da5e9 tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1273.684682] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1273.685261] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.685398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.685398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.685594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.685770] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.685919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.685979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.686142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.686518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.686518] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.189115] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.691574] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.195029] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.195029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.195029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.195029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.195029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.195029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1275.227837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.228031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.228031] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.228253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.228401] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.236989] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1277.247626] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1277.247995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.685948] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1278.686335] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.686811] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.686811] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.687996] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.688417] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.047285] env[69350]: INFO networking_nsxv3.common.synchronization [req-e459d314-f084-49f1-bce7-1a944996d4e6 req-eb5ee65d-833f-4736-b289-5287d4f697ec tempest-ServerActionsTestOtherA-813728833 tempest-ServerActionsTestOtherA-813728833-project-member] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1290.048110] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGHEST for action security_group_members [ 1290.048617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.048741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.048811] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.049032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.049195] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.049283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.049349] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.049496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.049582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.049714] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.552104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.552333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.552333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.552448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.552545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.552746] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.552848] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.552917] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.553151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.553245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.553348] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be updated. [ 1290.584446] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.584678] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.584729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.585013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.585290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.595290] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: IN_PROGRESS for 2s [ 1292.606284] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159146-6707-4314-98f2-9023803a47fc in Status: SUCCESS [ 1292.606668] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159146-6707-4314-98f2-9023803a47fc deletion is rescheduled due to dependency. [ 1292.606668] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.048818] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.049073] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.407837] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a789652f-29eb-4d3d-b392-e4438dbcafc4 None None] Enqueued Resource ID: 0e73a10a-aa60-4df8-9b1b-86352af34ea1 with Priority: HIGHEST for action port [ 1298.408179] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e73a10a-aa60-4df8-9b1b-86352af34ea1 with Priority: HIGHEST for action port [ 1298.408956] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e73a10a-aa60-4df8-9b1b-86352af34ea1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.408956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e73a10a-aa60-4df8-9b1b-86352af34ea1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.408956] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e73a10a-aa60-4df8-9b1b-86352af34ea1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.409177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e73a10a-aa60-4df8-9b1b-86352af34ea1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.409214] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e73a10a-aa60-4df8-9b1b-86352af34ea1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.911866] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e73a10a-aa60-4df8-9b1b-86352af34ea1 [ 1298.912030] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.912168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.912262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.913160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.913160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913160] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e73a10a-aa60-4df8-9b1b-86352af34ea1 already deleted. [ 1298.913160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e73a10a-aa60-4df8-9b1b-86352af34ea1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.645819] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0a6fa8ac-01fe-426f-bbff-5a8883dc5720 None None] Enqueued Resource ID: c14544b2-7299-4290-82db-2e2a3151baf0 with Priority: HIGHEST for action port [ 1300.646200] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14544b2-7299-4290-82db-2e2a3151baf0 with Priority: HIGHEST for action port [ 1300.646692] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-c14544b2-7299-4290-82db-2e2a3151baf0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.646827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c14544b2-7299-4290-82db-2e2a3151baf0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.646888] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c14544b2-7299-4290-82db-2e2a3151baf0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.647161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c14544b2-7299-4290-82db-2e2a3151baf0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.647250] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c14544b2-7299-4290-82db-2e2a3151baf0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.150059] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c14544b2-7299-4290-82db-2e2a3151baf0 [ 1301.150232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.150311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.150405] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.150643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.150736] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.150833] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c14544b2-7299-4290-82db-2e2a3151baf0 already deleted. [ 1301.150935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c14544b2-7299-4290-82db-2e2a3151baf0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.757925] env[69350]: INFO networking_nsxv3.common.synchronization [req-5ac2eb8e-bad6-426f-b7c8-7fef46e6e011 req-f2c73b69-4c72-4df5-bb71-89afe3f309f4 tempest-ServerPasswordTestJSON-474892784 tempest-ServerPasswordTestJSON-474892784-project-member] Enqueued Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1303.758464] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1303.758772] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.758892] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.758960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.759236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.759397] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.759500] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.759563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.759715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.759820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.760081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.262384] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.262582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.262963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.262963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.262963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.263559] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.263559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.263559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.263559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.263559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.263766] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 already deleted. [ 1304.263766] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.337764] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.337764] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.338080] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.338233] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.338581] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.338788] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.339228] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.339228] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.339387] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.339677] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.339832] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.339985] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.340168] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.340367] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.340483] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.340699] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.365804] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.366107] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.366332] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.366563] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-143" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.366944] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6b488518-6816-4e3c-947e-77f888bdc37c taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.367175] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.367319] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.367693] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.367906] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b488518-6816-4e3c-947e-77f888bdc37c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.871132] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.871560] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.871613] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.871920] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.872123] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.872323] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6b488518-6816-4e3c-947e-77f888bdc37c not found, creating... [ 1304.872611] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.872814] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.872960] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.873286] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.873441] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.873753] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.874044] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.874117] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.874354] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.874544] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.874724] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6b488518-6816-4e3c-947e-77f888bdc37c is going to be created. [ 1304.895726] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.895953] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.896069] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.896422] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.896671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.896896] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.580197] env[69350]: INFO networking_nsxv3.common.synchronization [req-5ac2eb8e-bad6-426f-b7c8-7fef46e6e011 req-202dece1-71bb-4ab5-b5ab-df5f54a84e0c service nova] Enqueued Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_rules [ 1305.580370] env[69350]: INFO networking_nsxv3.common.synchronization [req-5ac2eb8e-bad6-426f-b7c8-7fef46e6e011 req-202dece1-71bb-4ab5-b5ab-df5f54a84e0c service nova] Enqueued Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1305.580522] env[69350]: INFO networking_nsxv3.common.synchronization [req-5ac2eb8e-bad6-426f-b7c8-7fef46e6e011 req-202dece1-71bb-4ab5-b5ab-df5f54a84e0c service nova] Enqueued Resource ID: 6b488518-6816-4e3c-947e-77f888bdc37c with Priority: HIGHEST for action port [ 1305.580760] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_rules [ 1305.580918] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1305.581053] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b488518-6816-4e3c-947e-77f888bdc37c with Priority: HIGHEST for action port [ 1305.581641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.581878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.581971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.582374] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.582474] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.584054] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.584168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.584168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.584360] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.584761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.584761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.584761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.584943] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.585066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.585176] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.586303] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b488518-6816-4e3c-947e-77f888bdc37c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.586303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.586303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.586509] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.586606] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b488518-6816-4e3c-947e-77f888bdc37c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.088344] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.088675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.088716] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.089641] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b488518-6816-4e3c-947e-77f888bdc37c with status ACTIVE [ 1306.089827] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.089947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.090017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.090223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.090313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.090486] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.090578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.090638] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.090785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.090857] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.091044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.091161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.091222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.091330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.091400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.091493] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b488518-6816-4e3c-947e-77f888bdc37c is going to be updated. [ 1306.114286] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.114536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.114536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.114658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.114798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.114961] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b488518-6816-4e3c-947e-77f888bdc37c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.594742] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.097819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.098378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.098378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.098378] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.098543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.098543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 is going to be created. [ 1307.126637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.126879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.126879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.127068] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.127206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.137553] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: UNINITIALIZED for 2s [ 1307.411493] env[69350]: INFO networking_nsxv3.common.synchronization [req-a24d188f-40cc-4133-83ba-58d0fddcde8f req-d95d3ffd-4fff-443a-a3bb-217f592e5fbf tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1307.412088] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1307.412422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.412550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.412613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.412840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.417131] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.417131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.417131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.417131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.417131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.417131] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.919074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.919312] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.919413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.919681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.919801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.920057] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.920189] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.920275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.920478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.920584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.920691] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1307.960701] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.960701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.960701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.961021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.961021] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.969847] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1309.147857] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: SUCCESS [ 1309.148228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.148309] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.148553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.148750] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.148880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.148945] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.149156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.149237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.149321] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.149409] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.651687] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.651906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.651906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.652041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.652221] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.652404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.652404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.652545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.652632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.652760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.652866] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.652960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.653032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.653184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.653321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.653412] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.653471] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.653605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.653680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.653761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.654099] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.982286] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1309.982480] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 deletion is rescheduled due to dependency. [ 1309.982593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.156492] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e798eadb-b95f-4b24-8b57-576d46ec9704: rpc.has_security_group_logging(os_id): False [ 1310.175249] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.175477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.175537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.175760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.175862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.176176] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.176296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.176366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.176592] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.176677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.176857] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.176942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.177017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.177167] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.177241] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.177475] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.177593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.177593] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.177732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.177806] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.177990] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 is going to be created. [ 1310.215595] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1310.215733] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1310.251170] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.251320] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.251394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.251615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.251838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.261796] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: IN_PROGRESS for 2s [ 1312.277285] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: SUCCESS [ 1312.277658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.412922] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.413130] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.200533] env[69350]: INFO networking_nsxv3.common.synchronization [req-ad896e73-a0ca-455c-a05e-83f95baa9d5c req-d9bcffca-d7a6-4cf8-91bc-c7cf5f44c93e tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1315.201914] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1315.201914] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.201914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.201914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.201914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.202317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.202317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.202317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.202508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.202721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.202862] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.472527] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.473533] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.473833] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.474270] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.474682] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.475446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.475446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.475446] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.475703] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.475964] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.476151] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.476314] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.476494] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.476673] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.476874] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.477096] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.497482] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.497820] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1315.498050] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.498293] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-155" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.498683] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-4b387fc0-9827-4628-b111-ebbeaa40ef7d taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.498923] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.499113] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.499560] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.499866] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b387fc0-9827-4628-b111-ebbeaa40ef7d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.708812] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.709070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.709070] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.709351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.709474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.709714] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.709874] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.709965] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.710169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.710284] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.710400] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1315.733872] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.734085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.734085] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.734263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.734403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.743518] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1316.005391] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.005391] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 4b387fc0-9827-4628-b111-ebbeaa40ef7d not found, creating... [ 1316.005391] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.005391] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.005877] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.005877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.005877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.006017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.007205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.007205] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 4b387fc0-9827-4628-b111-ebbeaa40ef7d is going to be created. [ 1316.026179] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.026408] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.026559] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.026852] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.027095] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.027333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.040044] env[69350]: INFO networking_nsxv3.common.synchronization [req-22e2d703-a4f7-4b20-8e87-e950b65285e6 req-513a8199-c00f-4a64-b6f9-27e49a5228a6 tempest-ServerPasswordTestJSON-474892784 tempest-ServerPasswordTestJSON-474892784-project-member] Enqueued Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1316.040044] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGHEST for action security_group_members [ 1316.040044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.040044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.040044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.040044] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.151469] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.151663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.151769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.152111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.152348] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.543222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.543661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.543661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.543767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.543821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.543971] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.544099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.544154] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.544289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.544358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.544444] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 is going to be updated. [ 1316.579253] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.579436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.579477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.579702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.579850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.591163] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: IN_PROGRESS for 2s [ 1316.654866] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.723817] env[69350]: INFO networking_nsxv3.common.synchronization [req-ad896e73-a0ca-455c-a05e-83f95baa9d5c req-74bd9cf3-3f2a-4cbf-bde0-7d78d77e996f service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 1316.724026] env[69350]: INFO networking_nsxv3.common.synchronization [req-ad896e73-a0ca-455c-a05e-83f95baa9d5c req-74bd9cf3-3f2a-4cbf-bde0-7d78d77e996f service nova] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1316.724188] env[69350]: INFO networking_nsxv3.common.synchronization [req-ad896e73-a0ca-455c-a05e-83f95baa9d5c req-74bd9cf3-3f2a-4cbf-bde0-7d78d77e996f service nova] Enqueued Resource ID: 4b387fc0-9827-4628-b111-ebbeaa40ef7d with Priority: HIGHEST for action port [ 1316.724710] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_rules [ 1316.724818] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1316.724918] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b387fc0-9827-4628-b111-ebbeaa40ef7d with Priority: HIGHEST for action port [ 1316.725770] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.725902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.725982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.726210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.726298] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.727793] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.727881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.728088] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b387fc0-9827-4628-b111-ebbeaa40ef7d taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.728185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.728251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.728417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.728635] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b387fc0-9827-4628-b111-ebbeaa40ef7d',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.157105] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.230508] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.230750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.231428] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b387fc0-9827-4628-b111-ebbeaa40ef7d with status ACTIVE [ 1317.231701] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.231862] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.231991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.232249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.232373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.232607] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.232737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.232821] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.233028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.233138] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.233392] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.233517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.233602] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.233793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.233893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.234011] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b387fc0-9827-4628-b111-ebbeaa40ef7d is going to be updated. [ 1317.257162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.257368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.257368] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.257519] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.257680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.257845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b387fc0-9827-4628-b111-ebbeaa40ef7d" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.659935] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1317.660334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1317.762310] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1317.762496] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 deletion is rescheduled due to dependency. [ 1317.762544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.762701] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.762922] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.763138] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.763296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.763296] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.763445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.763665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.763805] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.265669] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.473996] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.473996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.473996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.473996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.487682] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1318.488587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.489436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1318.527273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.527447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.527508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.527703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.542398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.543168] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1318.543254] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1318.543353] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1318.588038] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.588235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.588235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.588451] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.589680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.589861] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1318.599540] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e798eadb-b95f-4b24-8b57-576d46ec9704 in Status: SUCCESS [ 1318.599729] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 deletion is rescheduled due to dependency. [ 1318.599823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.666672] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.667100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.667100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.667196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.667455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.667730] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1318.741644] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.741878] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.741926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.742280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.742662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.743051] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1318.743201] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'21f3cb76-3fba-47b9-bac9-ea6821feb810', 'e0eab42b-aa65-450c-a7c9-ef9dfeea65c1', '081c1f78-eea5-4d74-9bbb-1632062d2cbc', '49b616ed-5cd5-4814-a54b-e879de71d218', 'ac836d8b-740c-4a34-ae58-041041eb8e77', '5da239e8-9db8-4bbe-8e09-d7f855a6ffb7', 'e026144d-94fe-4b76-82b5-8dd361aa66d8', '2f159146-6707-4314-98f2-9023803a47fc', '935f66d0-48ab-44a6-9d44-d9c84d53af88', '9d3a437f-2228-4b2f-acaf-32ef289c6c55', 'd2c1ed42-adff-458a-8288-03bcbb9a7500', 'ce437c5a-9850-4106-9109-1794494f0682', 'c424677c-a7b4-455f-b6cc-392100496fd8', '75eb547d-6979-4aec-96c8-0d45c4db4c73', '9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6', 'baf89025-1b14-46a4-b655-853662f51662', '9afc4840-93eb-4fb0-b332-e1e98651f1ec', '30f3c1b0-c88c-48f8-a076-d6df7cdbf573', 'ffa8eacd-d072-4180-a46b-fc0e52002a8b', '4938dad0-1aaa-448e-8a86-4203e6ccd867', 'e798eadb-b95f-4b24-8b57-576d46ec9704', 'e27c7362-80ef-4c99-9dd6-75361259db7f', '1cefdec3-6da8-484c-9ff1-2845e8cd40a7', '7c5d6740-3439-4769-8b56-9e97215cbf77', '0fd7257c-afd4-47d6-ae01-960d2d62dba1', 'e0d278d1-7f84-49c8-97b0-0922016d1fd0', '0ab8bb33-410e-45b2-83bb-f1219bc73c45', '8c926423-569b-4b98-81ac-723b20e82ff8', '518254d1-d440-4d15-b32d-8975c834377a', '3546ebe1-f03c-4c52-959d-58ac3a2927bc', 'e42630d9-6f58-45c4-a768-a81a12bdfa43', 'a07d8013-92b1-46a1-acb2-34b3df1ac235', 'f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f', 'f77ff482-c36b-41a0-9c84-caa4cc51cf3d', '8bcf01dc-147d-49bc-839a-137d73c85e2d', '250212f8-b7b8-4a59-919a-a1ed1d003c9a', 'f9657ac2-98f3-4bb3-988b-9e7555afd46b', 'ce5d9ba7-7740-404a-9bcb-b276b50dbc4b', 'b7d6c991-1741-482f-bd6f-0a1e7794c335'} {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1318.743336] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1318.763594] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.763789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.763885] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.764173] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.764283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.764402] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1318.764489] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1318.764583] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1318.768231] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.850798] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.851037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.851037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.851239] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.852350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.852624] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1318.852704] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1318.852776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1318.852842] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1318.852919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1318.852991] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGH for action security_group_rules [ 1318.853084] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGH for action security_group_rules [ 1318.853152] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGH for action security_group_rules [ 1318.853216] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 1318.853304] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGH for action security_group_rules [ 1318.853383] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGH for action security_group_rules [ 1318.853446] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGH for action security_group_rules [ 1318.853507] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGH for action security_group_rules [ 1318.853570] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGH for action security_group_rules [ 1318.853632] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGH for action security_group_rules [ 1318.853694] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGH for action security_group_rules [ 1318.853756] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGH for action security_group_rules [ 1318.853818] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGH for action security_group_rules [ 1318.853881] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGH for action security_group_rules [ 1318.853944] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGH for action security_group_rules [ 1318.854015] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGH for action security_group_rules [ 1318.854084] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGH for action security_group_rules [ 1318.854146] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGH for action security_group_rules [ 1318.854209] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGH for action security_group_rules [ 1318.854270] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGH for action security_group_rules [ 1318.854375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.271749] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.272064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.272064] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.272510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.272635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.272741] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1319.303948] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.304051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.304175] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.304325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.304474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.313510] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1320.108884] env[69350]: INFO networking_nsxv3.common.synchronization [req-bebec1c0-ef09-4d05-a578-0b3d2a9a9430 req-e59baada-4a32-4ade-9612-2c2d4c97f083 tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1320.109466] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1320.109620] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 with Priority: HIGH for action security_group_rules [ 1320.109725] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGH for action security_group_rules [ 1320.109825] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 with Priority: HIGH for action security_group_rules [ 1320.109920] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 with Priority: HIGH for action security_group_rules [ 1320.110024] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 with Priority: HIGH for action security_group_rules [ 1320.110122] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b with Priority: HIGH for action security_group_rules [ 1320.110209] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 with Priority: HIGH for action security_group_rules [ 1320.110299] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec with Priority: HIGH for action security_group_rules [ 1320.110389] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 with Priority: HIGH for action security_group_rules [ 1320.110479] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGH for action security_group_rules [ 1320.110885] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c424677c-a7b4-455f-b6cc-392100496fd8 with Priority: HIGH for action security_group_rules [ 1320.110885] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce437c5a-9850-4106-9109-1794494f0682 with Priority: HIGH for action security_group_rules [ 1320.110885] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 with Priority: HIGH for action security_group_rules [ 1320.110885] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 with Priority: HIGH for action security_group_rules [ 1320.110885] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGH for action security_group_rules [ 1320.111248] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 with Priority: HIGH for action security_group_rules [ 1320.111248] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159146-6707-4314-98f2-9023803a47fc with Priority: HIGH for action security_group_rules [ 1320.111248] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac836d8b-740c-4a34-ae58-041041eb8e77 with Priority: HIGH for action security_group_rules [ 1320.111248] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 with Priority: HIGH for action security_group_rules [ 1320.111414] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b616ed-5cd5-4814-a54b-e879de71d218 with Priority: HIGH for action security_group_rules [ 1320.111589] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.111718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.111782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.111983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.112154] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.112247] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.112303] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.112446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.112530] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.112622] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.113596] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f3cb76-3fba-47b9-bac9-ea6821feb810 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.113692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.113692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.113847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.113924] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f3cb76-3fba-47b9-bac9-ea6821feb810',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.115036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.115151] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.115196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.115313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.115402] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.116096] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e026144d-94fe-4b76-82b5-8dd361aa66d8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.116206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.116270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.116484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.116550] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e026144d-94fe-4b76-82b5-8dd361aa66d8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.117461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.117461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.117461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.117793] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.117793] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.118367] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4938dad0-1aaa-448e-8a86-4203e6ccd867 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.118561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.118630] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.118747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.118858] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4938dad0-1aaa-448e-8a86-4203e6ccd867',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.119947] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.119947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.119947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.119947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.120292] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffa8eacd-d072-4180-a46b-fc0e52002a8b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.120995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.120995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.121125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.121224] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.121224] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30f3c1b0-c88c-48f8-a076-d6df7cdbf573',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.121881] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.121977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.122195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.122195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.122361] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afc4840-93eb-4fb0-b332-e1e98651f1ec',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.122995] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75eb547d-6979-4aec-96c8-0d45c4db4c73 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.123104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.123104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.123268] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.123340] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75eb547d-6979-4aec-96c8-0d45c4db4c73',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.126198] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.126358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.126409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.126645] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.126731] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.127952] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c424677c-a7b4-455f-b6cc-392100496fd8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.127952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.127952] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.128536] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.128536] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c424677c-a7b4-455f-b6cc-392100496fd8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.129203] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce437c5a-9850-4106-9109-1794494f0682 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.129203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.129203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.129492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.129492] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce437c5a-9850-4106-9109-1794494f0682',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.130307] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c1ed42-adff-458a-8288-03bcbb9a7500 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.130462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.130462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.130687] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.130802] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c1ed42-adff-458a-8288-03bcbb9a7500',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.131830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.131949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.132419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.132419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.132419] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d3a437f-2228-4b2f-acaf-32ef289c6c55',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.133069] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.133157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.133351] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.133479] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.133547] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.133728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.133805] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5da239e8-9db8-4bbe-8e09-d7f855a6ffb7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.134627] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159146-6707-4314-98f2-9023803a47fc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.134743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.134810] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.134977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.135077] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159146-6707-4314-98f2-9023803a47fc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.136026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac836d8b-740c-4a34-ae58-041041eb8e77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.136196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.136196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.136393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.136467] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac836d8b-740c-4a34-ae58-041041eb8e77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.137253] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.137365] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.137470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.137597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.137673] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0eab42b-aa65-450c-a7c9-ef9dfeea65c1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.138795] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49b616ed-5cd5-4814-a54b-e879de71d218 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.138929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.138929] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.139113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.139179] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49b616ed-5cd5-4814-a54b-e879de71d218',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.164381] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.164667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.164667] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.164883] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.186650] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.186808] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afc4840-93eb-4fb0-b332-e1e98651f1ec is going to be deleted. [ 1320.261655] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.261782] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.261849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.262091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.262184] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.262302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afc4840-93eb-4fb0-b332-e1e98651f1ec" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.648689] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.648933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.648973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.649233] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.655165] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.655351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.655450] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.655686] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.655857] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.655988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.656071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.656254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.656373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.656554] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.656604] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.707837] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.707837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.711790] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.712041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.724198] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.724470] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.725461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.725608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.726527] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.726652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.727389] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.727489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.728264] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.728357] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.729124] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.729228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.729959] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.730066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.730819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.730915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.731548] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.732107] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.732242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.732931] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.733400] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.733534] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.734766] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.735294] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.735437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.736100] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.736610] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.736737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.737454] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.737924] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.738036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.738688] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.739146] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.739238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.739813] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.740273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.740380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.741018] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1320.741591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.741862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.741999] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.742081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.742297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.742448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.742560] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1320.743712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.743936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.768423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.768590] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30f3c1b0-c88c-48f8-a076-d6df7cdbf573 is going to be deleted. [ 1320.770159] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.770436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.770560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.770687] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be deleted. [ 1320.772597] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.772769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.772820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.773017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.773201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.774385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.774620] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.786322] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1320.800032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.800211] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffa8eacd-d072-4180-a46b-fc0e52002a8b is going to be deleted. [ 1320.801515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.801835] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.827106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.827274] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49b616ed-5cd5-4814-a54b-e879de71d218 is going to be deleted. [ 1320.828351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.828608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.874539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.874785] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f3cb76-3fba-47b9-bac9-ea6821feb810 is going to be deleted. [ 1320.875757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.875987] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.916074] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.916628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.917649] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.917797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.921317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.921317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.935853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.936085] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e026144d-94fe-4b76-82b5-8dd361aa66d8 is going to be deleted. [ 1320.937199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.937458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.939820] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.940045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.985340] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.985561] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75eb547d-6979-4aec-96c8-0d45c4db4c73 is going to be deleted. [ 1320.986529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.986767] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.071254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.071436] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d3a437f-2228-4b2f-acaf-32ef289c6c55 is going to be deleted. [ 1321.072532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.072532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.100512] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.100512] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.101169] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.101266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.113950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.114192] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce437c5a-9850-4106-9109-1794494f0682 is going to be deleted. [ 1321.114975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.115213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.146316] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.146462] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5da239e8-9db8-4bbe-8e09-d7f855a6ffb7 is going to be deleted. [ 1321.150053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.150364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.173892] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.184236] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.184490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.267553] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.267690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.274385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.274586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.286759] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.286977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.287877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.287998] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6 is going to be deleted. [ 1321.289093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.289333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.340895] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1321.341176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.341389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.341648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.341856] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.341979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.342059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.342222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.342311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.342465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.342545] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.363171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.363716] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c424677c-a7b4-455f-b6cc-392100496fd8 is going to be deleted. [ 1321.366102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.366516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.440217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.440217] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac836d8b-740c-4a34-ae58-041041eb8e77 is going to be deleted. [ 1321.441366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.441641] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.470677] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.470855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.487548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.487745] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c1ed42-adff-458a-8288-03bcbb9a7500 is going to be deleted. [ 1321.488674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.488899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.514842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.514992] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4938dad0-1aaa-448e-8a86-4203e6ccd867 is going to be deleted. [ 1321.516019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.516218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.548104] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.548290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.576951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.577126] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0eab42b-aa65-450c-a7c9-ef9dfeea65c1 is going to be deleted. [ 1321.578110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.578333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.603942] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.604177] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.621552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.621691] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159146-6707-4314-98f2-9023803a47fc is going to be deleted. [ 1321.623137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.623137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.623137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.623137] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30f3c1b0-c88c-48f8-a076-d6df7cdbf573" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.623299] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.623422] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.623498] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.623615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.624258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.624424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.624520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.624626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffa8eacd-d072-4180-a46b-fc0e52002a8b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.624756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.624911] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.624969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.625097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49b616ed-5cd5-4814-a54b-e879de71d218" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.625221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.625359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.625488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.625607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e026144d-94fe-4b76-82b5-8dd361aa66d8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.625732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.625871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.625944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.626069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f3cb76-3fba-47b9-bac9-ea6821feb810" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.626192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.626330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.626403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.626518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75eb547d-6979-4aec-96c8-0d45c4db4c73" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.626639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.626773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.626845] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.627249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce437c5a-9850-4106-9109-1794494f0682" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.627249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.627249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.627359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.627396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5da239e8-9db8-4bbe-8e09-d7f855a6ffb7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.627490] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.627627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.627699] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.627804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d3a437f-2228-4b2f-acaf-32ef289c6c55" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a2fa33a-ee8d-4a3b-ba66-c49fb96813b6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c424677c-a7b4-455f-b6cc-392100496fd8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.630856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac836d8b-740c-4a34-ae58-041041eb8e77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.645718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.645867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.645935] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.646172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.646264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.646377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4938dad0-1aaa-448e-8a86-4203e6ccd867" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.665222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.665580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.665580] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.665815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.665815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.665915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c1ed42-adff-458a-8288-03bcbb9a7500" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.678302] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 081c1f78-eea5-4d74-9bbb-1632062d2cbc: rpc.has_security_group_logging(os_id): False [ 1321.708780] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.708949] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.709032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.709240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.715157] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.715350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.775570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.775570] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.775570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.775570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.775570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.775570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.775991] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc is going to be updated. [ 1321.776753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.776938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.777035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.777152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0eab42b-aa65-450c-a7c9-ef9dfeea65c1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.778033] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.778164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.778164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.778311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.778389] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.778971] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159146-6707-4314-98f2-9023803a47fc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.844468] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.891609] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.891832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.891832] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.892071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.892237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.920821] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: IN_PROGRESS for 2s [ 1322.346758] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 935f66d0-48ab-44a6-9d44-d9c84d53af88: rpc.has_security_group_logging(os_id): False [ 1322.367101] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.367318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.367318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.367518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.387990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.388322] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.388448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.388516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.388731] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.388815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.388891] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1322.451350] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.451552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.451552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.451776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.451933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.469313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1322.797348] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1322.797546] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 deletion is rescheduled due to dependency. [ 1322.797659] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.939773] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: SUCCESS [ 1323.940341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.484147] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1324.484382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.484583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.484840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.484933] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.987529] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.987866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.987866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.987996] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.988162] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.988256] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.988318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.988458] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.988545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.988632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.988720] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.112980] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.112980] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1325.492222] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.994057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 935f66d0-48ab-44a6-9d44-d9c84d53af88: rpc.has_security_group_logging(os_id): False [ 1326.019036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.019036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.019036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.019036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.019527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.019527] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.019527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.019527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.019690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.019690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.019756] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1326.082423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.082614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.082663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.082853] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.083022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.097529] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1328.113158] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1328.113545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.334605] env[69350]: INFO networking_nsxv3.common.synchronization [req-1a3dbdd9-646d-401a-8f2b-c4b7d1297950 req-9ebc1d78-2d2d-4136-8178-5addae9faf98 tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1329.335174] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1329.335494] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.335758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.335758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.335886] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.336100] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.336191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.336191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.336485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.336603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.336751] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.606923] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.607151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.607281] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.607564] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.607840] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.607996] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.608129] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.608347] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.608498] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.608724] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.608870] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.608987] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.609116] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.609237] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.609348] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.609483] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.629024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.629211] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1329.629358] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.629572] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.629851] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-a18656d9-a69e-4c00-9d65-063159beb62e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.630034] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.630160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.630493] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.630640] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18656d9-a69e-4c00-9d65-063159beb62e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.839505] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.839741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.839741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.839974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.840086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.840277] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.840377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.840434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.840586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.840661] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.840749] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be deleted. [ 1329.870239] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.870462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.870462] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.870656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.870755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.870879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.132792] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.133073] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.133246] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.133603] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.133702] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.134086] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port a18656d9-a69e-4c00-9d65-063159beb62e not found, creating... [ 1330.134138] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.134302] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.134424] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.134651] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.134795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.135100] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.135263] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.135384] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.135672] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.135806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.135948] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: a18656d9-a69e-4c00-9d65-063159beb62e is going to be created. [ 1330.157592] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.157829] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.157954] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.158322] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.158602] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.158859] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.061522] env[69350]: INFO networking_nsxv3.common.synchronization [req-1a3dbdd9-646d-401a-8f2b-c4b7d1297950 req-f65988f2-c3e7-4522-9fb7-d097ae030112 service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1331.061785] env[69350]: INFO networking_nsxv3.common.synchronization [req-1a3dbdd9-646d-401a-8f2b-c4b7d1297950 req-f65988f2-c3e7-4522-9fb7-d097ae030112 service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1331.061849] env[69350]: INFO networking_nsxv3.common.synchronization [req-1a3dbdd9-646d-401a-8f2b-c4b7d1297950 req-f65988f2-c3e7-4522-9fb7-d097ae030112 service nova] Enqueued Resource ID: a18656d9-a69e-4c00-9d65-063159beb62e with Priority: HIGHEST for action port [ 1331.062082] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1331.062217] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1331.062314] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18656d9-a69e-4c00-9d65-063159beb62e with Priority: HIGHEST for action port [ 1331.062859] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.062990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.063197] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.063419] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.063553] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.066155] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.066274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.066342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.066546] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.067025] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.067141] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.067227] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.067556] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.067655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.067752] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.068803] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a18656d9-a69e-4c00-9d65-063159beb62e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.068905] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.069073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.069250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.069327] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18656d9-a69e-4c00-9d65-063159beb62e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.567190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.567408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.569708] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.570600] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a18656d9-a69e-4c00-9d65-063159beb62e with status ACTIVE [ 1331.570784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.570902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.570968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.571193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.571285] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.571453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.571552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.571619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.571788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.571873] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.572055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.572150] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.572211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.572351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.572423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.572505] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a18656d9-a69e-4c00-9d65-063159beb62e is going to be updated. [ 1331.595126] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.595333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.595333] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.595559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.595700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.595858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.076498] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.579302] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.579521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.579521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.579791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.579895] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.580016] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be created. [ 1332.609196] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.609421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.609421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.609599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.609759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.620309] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: UNINITIALIZED for 2s [ 1334.631483] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1334.631858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.631858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.632045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.632175] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.632295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.632351] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.632504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.632583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.632670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.632761] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.135754] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.638075] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baf89025-1b14-46a4-b655-853662f51662: rpc.has_security_group_logging(os_id): False [ 1335.661480] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.661679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.661756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.661940] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.662047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.662295] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.662396] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.662457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.662612] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.662690] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.662776] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be created. [ 1335.722106] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.722334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.722334] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.722583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.722752] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.734089] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1336.063131] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.063308] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1337.750334] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1337.750703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.065067] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.065067] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.065791] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.066070] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.067833] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.067833] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.752027] env[69350]: INFO networking_nsxv3.common.synchronization [req-30ec2b90-5b38-4044-b889-f86d9d7b7c64 req-ff88f125-c862-4abf-bab7-b18d11949fcb tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1351.752568] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGHEST for action security_group_members [ 1351.752879] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.753008] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.753081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.753275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.753425] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.753520] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.753575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.753749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.753834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.753928] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.258767] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.259206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.259206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.259362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.259514] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.259744] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.259899] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.259966] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.260172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.260293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.260404] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc is going to be updated. [ 1352.289310] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.289527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.289527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.289712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.289854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.299877] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: IN_PROGRESS for 2s [ 1354.310012] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc in Status: SUCCESS [ 1354.310260] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc deletion is rescheduled due to dependency. [ 1354.310342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.753272] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.753641] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.754139] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.754506] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.969528] env[69350]: INFO networking_nsxv3.common.synchronization [req-77c4b5a7-96e3-4522-a4ac-3d5eed4b6f60 req-eda11e24-9cba-41f2-886d-f2ac6320972f tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1362.969802] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1362.970111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.970283] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.971036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.971036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.971036] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.971036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.971336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.971336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.971448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.971574] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.474594] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.979099] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.481582] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.481737] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.481819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.482099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.482200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.482299] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be updated. [ 1364.511102] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.511295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.511350] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.511535] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.511680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.521446] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1366.532152] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1366.532528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.970925] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.970925] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.716232] env[69350]: INFO networking_nsxv3.common.synchronization [req-1cb8da8f-f524-4a4c-9c43-071c7d1da7ed req-32398385-8894-4cbd-8905-241364d85a6f tempest-ServerRescueNegativeTestJSON-1717392500 tempest-ServerRescueNegativeTestJSON-1717392500-project-member] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1369.720132] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGHEST for action security_group_members [ 1369.720132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.720132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.720132] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.720132] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.222591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.222865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.222865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.223110] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.247026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.247026] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.247026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.247026] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.247315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.247315] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.247438] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be updated. [ 1370.275034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.275223] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.275297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.275552] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.275652] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.284775] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: IN_PROGRESS for 2s [ 1372.295229] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 in Status: SUCCESS [ 1372.295594] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 deletion is rescheduled due to dependency. [ 1372.295594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.718981] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.719367] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.615733] env[69350]: INFO networking_nsxv3.common.synchronization [req-88de1b29-fd31-4322-8cc9-4e0919d88838 req-29da5a7f-6ed8-443b-86b7-06cd67006f3f tempest-ServerActionsTestJSON-1297421071 tempest-ServerActionsTestJSON-1297421071-project-member] Enqueued Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1377.616355] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 with Priority: HIGHEST for action security_group_members [ 1377.616667] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-935f66d0-48ab-44a6-9d44-d9c84d53af88 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.616785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.616870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.617097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.617265] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.617366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.617424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.617588] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.617669] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.617767] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('935f66d0-48ab-44a6-9d44-d9c84d53af88',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.991789] env[69350]: INFO networking_nsxv3.common.synchronization [None req-cb8e8e0d-5d26-4b29-8628-1b067cafe75e None None] Enqueued Resource ID: 69f3a8a9-0c65-48a2-ba96-8efcb740a05c with Priority: HIGHEST for action port [ 1377.992562] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f3a8a9-0c65-48a2-ba96-8efcb740a05c with Priority: HIGHEST for action port [ 1377.993058] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-69f3a8a9-0c65-48a2-ba96-8efcb740a05c taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.993426] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69f3a8a9-0c65-48a2-ba96-8efcb740a05c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.993615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69f3a8a9-0c65-48a2-ba96-8efcb740a05c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.993962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69f3a8a9-0c65-48a2-ba96-8efcb740a05c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.994191] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69f3a8a9-0c65-48a2-ba96-8efcb740a05c',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.119571] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.122675] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.122675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.122675] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 is going to be updated. [ 1378.154366] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.154366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.154366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.154366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.154366] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.164507] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: IN_PROGRESS for 2s [ 1378.497321] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69f3a8a9-0c65-48a2-ba96-8efcb740a05c [ 1378.498784] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.498784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.498784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.498784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.498784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.498784] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69f3a8a9-0c65-48a2-ba96-8efcb740a05c already deleted. [ 1378.498784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69f3a8a9-0c65-48a2-ba96-8efcb740a05c" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.924309] env[69350]: INFO networking_nsxv3.common.synchronization [None req-47ea3620-58a0-420e-9ebb-f780d885582c tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1378.924309] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1378.924309] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.924867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.925142] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.925573] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.925832] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.024134] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c08a6e67-8e39-4815-9283-e80d4647cf6f tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1379.025664] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1379.025664] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.025664] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.446811] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.447035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.447035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.447291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.447386] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.447484] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 already deleted. [ 1379.447567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.447792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.447879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.447936] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.816412] env[69350]: INFO networking_nsxv3.common.synchronization [None req-9726abd0-12e8-461d-a965-55c4f00ae638 None None] Enqueued Resource ID: d36974e4-d01c-48cc-9bdb-601a024e1544 with Priority: HIGHEST for action port [ 1379.816657] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d36974e4-d01c-48cc-9bdb-601a024e1544 with Priority: HIGHEST for action port [ 1379.817267] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-d36974e4-d01c-48cc-9bdb-601a024e1544 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.817387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d36974e4-d01c-48cc-9bdb-601a024e1544" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.817449] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d36974e4-d01c-48cc-9bdb-601a024e1544" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.817712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d36974e4-d01c-48cc-9bdb-601a024e1544" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.817795] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d36974e4-d01c-48cc-9bdb-601a024e1544',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.967682] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.967682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.967682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.967682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.967682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.967682] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 already deleted. [ 1379.967682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.176763] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 in Status: SUCCESS [ 1380.176970] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 935f66d0-48ab-44a6-9d44-d9c84d53af88 deletion is rescheduled due to dependency. [ 1380.177057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-935f66d0-48ab-44a6-9d44-d9c84d53af88" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.321601] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d36974e4-d01c-48cc-9bdb-601a024e1544 [ 1380.322051] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.322161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.322198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.322919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.322919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.322919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d36974e4-d01c-48cc-9bdb-601a024e1544 already deleted. [ 1380.322919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d36974e4-d01c-48cc-9bdb-601a024e1544" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.817674] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.817988] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.573761] env[69350]: INFO networking_nsxv3.common.synchronization [req-09cfe0a2-964a-4a56-a979-a4a75a7bdee7 req-b1fc3432-1e9c-48f0-a36a-5cb35efe8050 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1385.574333] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1385.574665] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.574798] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.574867] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.575140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.575296] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.575394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.575455] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.575605] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.575685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.575776] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.850606] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.850920] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.850974] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.851392] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.851697] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.851917] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.852086] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.852356] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.852545] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.852799] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1385.852954] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1385.853057] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1385.853171] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1385.853296] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1385.853475] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1385.853534] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1385.875351] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1385.875524] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1385.875667] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1385.875900] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.876325] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-8e2b12d3-7340-4b70-8c03-e6f29503807a taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.876513] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.876637] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.876975] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.877207] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e2b12d3-7340-4b70-8c03-e6f29503807a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.080043] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.080043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.080043] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.080297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.080297] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.080483] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.080590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.080590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.080744] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.080819] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.080904] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 already deleted. [ 1386.080977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.380256] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.381101] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.381101] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.381301] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.381350] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.381543] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 8e2b12d3-7340-4b70-8c03-e6f29503807a not found, creating... [ 1386.381883] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.382103] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.382270] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.382540] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.382729] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.383084] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.383299] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.383447] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.383915] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.383915] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.384057] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 8e2b12d3-7340-4b70-8c03-e6f29503807a is going to be created. [ 1386.405799] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.406195] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.406393] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.406763] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.407140] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.407466] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.112758] env[69350]: INFO networking_nsxv3.common.synchronization [req-09cfe0a2-964a-4a56-a979-a4a75a7bdee7 req-ea14b8e4-0d21-4bca-a085-c6d7b6fce94f service nova] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1387.113066] env[69350]: INFO networking_nsxv3.common.synchronization [req-09cfe0a2-964a-4a56-a979-a4a75a7bdee7 req-ea14b8e4-0d21-4bca-a085-c6d7b6fce94f service nova] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1387.113134] env[69350]: INFO networking_nsxv3.common.synchronization [req-09cfe0a2-964a-4a56-a979-a4a75a7bdee7 req-ea14b8e4-0d21-4bca-a085-c6d7b6fce94f service nova] Enqueued Resource ID: 8e2b12d3-7340-4b70-8c03-e6f29503807a with Priority: HIGHEST for action port [ 1387.113317] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_rules [ 1387.113448] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1387.113551] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e2b12d3-7340-4b70-8c03-e6f29503807a with Priority: HIGHEST for action port [ 1387.114373] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.114517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.114578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.114773] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.114854] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.116243] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.116376] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.116542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.116716] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.116871] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.116969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.117053] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.117210] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.117286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.117378] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.120629] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e2b12d3-7340-4b70-8c03-e6f29503807a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.120629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.120629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.120629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.120629] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e2b12d3-7340-4b70-8c03-e6f29503807a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.617601] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.617827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.622103] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.623105] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e2b12d3-7340-4b70-8c03-e6f29503807a with status ACTIVE [ 1387.623309] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.623437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.623506] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.623722] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.623817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.623987] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.624205] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.624346] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.624528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.624617] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.624813] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.624919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.625028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.625146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.625225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.625313] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e2b12d3-7340-4b70-8c03-e6f29503807a is going to be updated. [ 1387.646646] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.647022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.647022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.647022] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.647216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.647336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e2b12d3-7340-4b70-8c03-e6f29503807a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.127173] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.630449] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.630670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.630670] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.631096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.631096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.631096] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 is going to be created. [ 1388.658768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.659012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.659012] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.659212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.659375] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.669069] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: UNINITIALIZED for 2s [ 1390.680607] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: SUCCESS [ 1390.681047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.681047] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.681270] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.681464] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.681578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.681653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.681924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.681924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.682010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.682051] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.184241] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.687074] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2156de29-689e-4010-ab8c-c4f9f41ec347: rpc.has_security_group_logging(os_id): False [ 1391.704541] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.704791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.704791] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.704982] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.705100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.705324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.705420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.705484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.705639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.705714] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.705798] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 is going to be created. [ 1391.766613] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.766856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.766856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.767041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.767279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.778912] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: IN_PROGRESS for 2s [ 1392.115072] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.115354] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1393.791528] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: SUCCESS [ 1393.791947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.115919] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.116299] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.116881] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.117195] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.384240] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.384666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.384666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.384946] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.385251] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.385611] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.385690] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.385944] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.386087] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.386352] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1403.386486] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1403.386609] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1403.386717] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1403.386888] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1403.386968] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1403.387161] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1403.408690] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1403.408852] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1403.408977] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1403.409174] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-483" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.409490] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-a18656d9-a69e-4c00-9d65-063159beb62e taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.409671] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.409800] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.410071] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.410215] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18656d9-a69e-4c00-9d65-063159beb62e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.913250] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.913494] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.913608] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.913939] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.914207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.914691] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.914965] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.915204] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.915529] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.915784] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.916256] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.916509] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.916735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.917090] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.917308] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.917551] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: a18656d9-a69e-4c00-9d65-063159beb62e is going to be updated. [ 1403.940783] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.941203] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.941462] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.941904] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.942266] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.942634] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.603620] env[69350]: INFO networking_nsxv3.common.synchronization [req-6b527bd7-b3d1-4a26-b0de-7c6971969d17 req-e0b5f8e3-2c27-44dc-b9f5-192128c95c46 service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1404.603869] env[69350]: INFO networking_nsxv3.common.synchronization [req-6b527bd7-b3d1-4a26-b0de-7c6971969d17 req-e0b5f8e3-2c27-44dc-b9f5-192128c95c46 service nova] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1404.603975] env[69350]: INFO networking_nsxv3.common.synchronization [req-6b527bd7-b3d1-4a26-b0de-7c6971969d17 req-e0b5f8e3-2c27-44dc-b9f5-192128c95c46 service nova] Enqueued Resource ID: a18656d9-a69e-4c00-9d65-063159beb62e with Priority: HIGHEST for action port [ 1404.604199] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_rules [ 1404.604337] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1404.604432] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18656d9-a69e-4c00-9d65-063159beb62e with Priority: HIGHEST for action port [ 1404.604966] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.605107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.605172] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.605385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.605473] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.606257] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.607069] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.607258] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.607385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.607491] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.607627] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.607679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.607809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.607894] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.607982] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.609081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-a18656d9-a69e-4c00-9d65-063159beb62e taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.609081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.609081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.609081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.609311] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18656d9-a69e-4c00-9d65-063159beb62e',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.111097] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.111369] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.111483] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.112445] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a18656d9-a69e-4c00-9d65-063159beb62e with status ACTIVE [ 1405.112615] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.112615] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.112771] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.113551] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.113551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.113897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.113897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.113973] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.114131] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.114199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.114288] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a18656d9-a69e-4c00-9d65-063159beb62e is going to be updated. [ 1405.136665] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.136925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.136925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.137077] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.137221] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.137414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a18656d9-a69e-4c00-9d65-063159beb62e" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.616162] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.119453] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.119695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.119695] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.120075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.120075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.120249] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1406.148337] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.148582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.148582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.148761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.148910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.157646] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1408.168638] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1408.169066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.169066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.169265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.169447] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.169563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.169629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.169778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.169860] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.169947] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.170081] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.672348] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.176127] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baf89025-1b14-46a4-b655-853662f51662: rpc.has_security_group_logging(os_id): False [ 1409.193654] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.193904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.194057] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.194253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.194341] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.194608] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.194753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.194753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.194939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.195055] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.195146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1409.261330] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.261614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.261614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.261902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.262157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.278951] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1409.605472] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.605566] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1411.300464] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1411.300833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.606914] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.607418] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.607847] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.608237] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.363355] env[69350]: INFO networking_nsxv3.common.synchronization [req-244f1fbd-2b5f-4b07-bf8b-9da9433e0f96 req-cbb9e8d9-8ceb-46fa-bb09-472070bd59e4 tempest-ServerActionsTestOtherB-1749293700 tempest-ServerActionsTestOtherB-1749293700-project-member] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1420.363889] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGHEST for action security_group_members [ 1420.364222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.364353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.364415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.364655] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.364815] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.364918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.365045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.365160] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.365237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.365329] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.869641] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.870094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.870094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.870094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.870237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.870346] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.870447] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.870510] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.870683] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.870762] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.870850] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be updated. [ 1420.899851] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.900080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.900080] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.900267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.900407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.917254] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: IN_PROGRESS for 2s [ 1422.928468] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baf89025-1b14-46a4-b655-853662f51662 in Status: SUCCESS [ 1422.928854] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baf89025-1b14-46a4-b655-853662f51662 deletion is rescheduled due to dependency. [ 1422.928854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.365846] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.366727] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.367035] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.367558] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.997126] env[69350]: INFO networking_nsxv3.common.synchronization [None req-057479cd-6683-4e00-a8c5-59cf1c144c01 None None] Enqueued Resource ID: 8354a756-dc63-4700-8c99-52129eaa2743 with Priority: HIGHEST for action port [ 1431.997689] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8354a756-dc63-4700-8c99-52129eaa2743 with Priority: HIGHEST for action port [ 1431.998017] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-8354a756-dc63-4700-8c99-52129eaa2743 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.998147] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8354a756-dc63-4700-8c99-52129eaa2743" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.998216] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8354a756-dc63-4700-8c99-52129eaa2743" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.998476] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8354a756-dc63-4700-8c99-52129eaa2743" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.998559] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8354a756-dc63-4700-8c99-52129eaa2743',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.501327] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8354a756-dc63-4700-8c99-52129eaa2743 [ 1432.502421] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.502421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.502421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.502421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.502421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.502421] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8354a756-dc63-4700-8c99-52129eaa2743 already deleted. [ 1432.502421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8354a756-dc63-4700-8c99-52129eaa2743" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.560660] env[69350]: INFO networking_nsxv3.common.synchronization [None req-f42ccd81-f3a9-4178-847d-44bcfa52c5f4 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1432.560660] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1432.560660] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.561527] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.562128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.563245] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.563245] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.632918] env[69350]: INFO networking_nsxv3.common.synchronization [None req-0f681262-fa68-456e-aeec-e53e76bf516e tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1432.633485] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1432.633728] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.633801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.086994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.086994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.087326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.087326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.087391] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.087560] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 already deleted. [ 1433.087653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.087816] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.087963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.088060] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.608325] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.608325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.608325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.608325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.608325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.608325] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 already deleted. [ 1433.608325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.142163] env[69350]: INFO networking_nsxv3.common.synchronization [None req-c8f5ef99-0015-4dc9-b6cd-08b483530f4d None None] Enqueued Resource ID: ae14fd64-69f8-4318-b40c-4a60edd9db80 with Priority: HIGHEST for action port [ 1434.142439] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae14fd64-69f8-4318-b40c-4a60edd9db80 with Priority: HIGHEST for action port [ 1434.142994] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae14fd64-69f8-4318-b40c-4a60edd9db80 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.143140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae14fd64-69f8-4318-b40c-4a60edd9db80" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.143237] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae14fd64-69f8-4318-b40c-4a60edd9db80" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.143465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae14fd64-69f8-4318-b40c-4a60edd9db80" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.143549] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae14fd64-69f8-4318-b40c-4a60edd9db80',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.645709] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae14fd64-69f8-4318-b40c-4a60edd9db80 [ 1434.645945] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.646096] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.646169] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.646384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.646473] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.646568] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae14fd64-69f8-4318-b40c-4a60edd9db80 already deleted. [ 1434.646703] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae14fd64-69f8-4318-b40c-4a60edd9db80" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.613955] env[69350]: INFO networking_nsxv3.common.synchronization [req-5b5e5757-e0f5-41d3-9c7e-715ddfe8659d req-33bd1c10-194b-4780-b789-e796a11c9fb8 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1438.614662] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1438.615034] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.615171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.615266] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.615503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.615674] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.615866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.615866] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.616099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.616099] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.616214] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.118808] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.119049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.119111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.119325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.119425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.119637] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.119746] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.119840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.120039] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.120125] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.120287] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 already deleted. [ 1439.120287] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.162205] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.162421] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.162518] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.162914] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.163132] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.163299] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.163433] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.163652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.163797] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.164020] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1439.164139] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1439.164250] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1439.164361] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1439.164469] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1439.164574] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1439.164736] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1439.193047] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1439.193047] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1439.193047] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1439.193047] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.193339] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.193491] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.193558] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.193985] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.194180] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('087f6adf-44c2-4f41-a0b5-bc40d1bd9b47',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.696662] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.697083] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.697222] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.697551] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.697723] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.697931] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 not found, creating... [ 1439.698228] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.698390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.698512] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.698754] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.698896] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.699231] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.699397] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.699517] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.699735] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.699877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.700033] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 is going to be created. [ 1439.720982] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.721251] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.721390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.721739] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.721994] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.722242] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.400924] env[69350]: INFO networking_nsxv3.common.synchronization [req-5b5e5757-e0f5-41d3-9c7e-715ddfe8659d req-0630dcd0-87a8-4402-9023-d86ef5a3d158 service nova] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1440.401125] env[69350]: INFO networking_nsxv3.common.synchronization [req-5b5e5757-e0f5-41d3-9c7e-715ddfe8659d req-0630dcd0-87a8-4402-9023-d86ef5a3d158 service nova] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1440.401276] env[69350]: INFO networking_nsxv3.common.synchronization [req-5b5e5757-e0f5-41d3-9c7e-715ddfe8659d req-0630dcd0-87a8-4402-9023-d86ef5a3d158 service nova] Enqueued Resource ID: 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 with Priority: HIGHEST for action port [ 1440.401520] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_rules [ 1440.401651] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1440.401750] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 with Priority: HIGHEST for action port [ 1440.402319] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.402541] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.402628] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.402839] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.402926] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.403781] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.404515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.404515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.404515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.404515] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.404515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.404515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.404930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.404930] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.404930] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.406058] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.406058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.406058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.406209] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.406245] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('087f6adf-44c2-4f41-a0b5-bc40d1bd9b47',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.907872] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.908944] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.909094] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.910389] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 with status ACTIVE [ 1440.910569] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.910682] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.910739] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.910960] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.911063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.911232] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.911331] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.911387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.911561] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.911639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.911819] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.911912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.911969] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.912128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.912202] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.912286] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 087f6adf-44c2-4f41-a0b5-bc40d1bd9b47 is going to be updated. [ 1440.933673] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.933893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.933893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.934353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.934353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.934522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-087f6adf-44c2-4f41-a0b5-bc40d1bd9b47" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.414071] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.916684] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.917195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.917195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.917195] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.917323] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.917465] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 is going to be created. [ 1441.945584] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.945831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.945938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.946222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.946515] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.956174] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: UNINITIALIZED for 2s [ 1442.086452] env[69350]: INFO networking_nsxv3.common.synchronization [None req-b4daec05-85fe-47ab-9454-1156ccd6036d tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1442.087020] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1442.087324] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.087448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.087513] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.087804] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.087884] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.167936] env[69350]: INFO networking_nsxv3.common.synchronization [None req-a9ac1f23-6aa2-421b-91e7-53168da8ba74 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1442.168320] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1442.168660] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.168772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.613448] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.613606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.613705] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.613912] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.614017] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.614126] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 already deleted. [ 1442.614214] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.614373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.614533] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.614621] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.135385] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.135740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.135740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.135977] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.136120] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.136253] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 already deleted. [ 1443.136371] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.966013] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: SUCCESS [ 1443.966327] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.966421] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.966647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.966869] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.966989] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.967067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.967231] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.967313] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.967397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.967489] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.470160] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.972036] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6: rpc.has_security_group_logging(os_id): False [ 1444.989977] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.990161] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.990203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.990417] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.990504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.990738] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.990837] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.990902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.991063] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.991140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.991225] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 is going to be created. [ 1445.046993] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.047165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.047235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.047448] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.047636] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.058186] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: IN_PROGRESS for 2s [ 1447.071532] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: SUCCESS [ 1447.071925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.169672] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.169900] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.145018] env[69350]: INFO networking_nsxv3.common.synchronization [req-a2e46a4a-961b-4cd0-9dad-920912e3218c req-69c293bb-f55c-434f-a35d-345033532f9f tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1448.145553] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1448.146032] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.146032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.146204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.146409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.146578] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.146685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.146747] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.147537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.147648] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.147750] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.471142] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.471354] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.471484] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.471758] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.472027] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.472193] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.472314] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.472532] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.472780] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.473029] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.473155] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1448.473271] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1448.473383] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1448.473496] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.473608] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1448.473743] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1448.493863] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1448.494044] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1448.494188] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1448.494364] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.494676] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-1412d053-4ac7-4ae0-b5b8-3a68ae068610 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.494890] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.495049] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.495390] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.495540] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1412d053-4ac7-4ae0-b5b8-3a68ae068610',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.650535] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.650719] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.650764] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.650978] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.651084] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.651280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.651380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.651437] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.651589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.651663] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.651748] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 already deleted. [ 1448.651830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.997532] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.997797] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.997943] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.998334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.998402] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.998555] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 1412d053-4ac7-4ae0-b5b8-3a68ae068610 not found, creating... [ 1448.998813] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.999017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.999333] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.999577] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.999753] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.000082] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.000254] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.000377] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.000604] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.000743] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.000900] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 1412d053-4ac7-4ae0-b5b8-3a68ae068610 is going to be created. [ 1449.021889] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.022303] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.022556] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.022986] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.023334] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.023682] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [req-a2e46a4a-961b-4cd0-9dad-920912e3218c req-679a1f44-cd51-4cf1-b11e-0e732b6651c2 service nova] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [req-a2e46a4a-961b-4cd0-9dad-920912e3218c req-679a1f44-cd51-4cf1-b11e-0e732b6651c2 service nova] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [req-a2e46a4a-961b-4cd0-9dad-920912e3218c req-679a1f44-cd51-4cf1-b11e-0e732b6651c2 service nova] Enqueued Resource ID: 1412d053-4ac7-4ae0-b5b8-3a68ae068610 with Priority: HIGHEST for action port [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_rules [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1449.696678] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1412d053-4ac7-4ae0-b5b8-3a68ae068610 with Priority: HIGHEST for action port [ 1449.697271] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.697407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.697407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.697613] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.697664] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.698903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.699032] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.699098] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.699293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.699445] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.699543] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.699599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.699743] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.699870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.699922] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.700746] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-1412d053-4ac7-4ae0-b5b8-3a68ae068610 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.704019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.704019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.704019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.704019] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1412d053-4ac7-4ae0-b5b8-3a68ae068610',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.203358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.203358] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.203498] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.204912] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1412d053-4ac7-4ae0-b5b8-3a68ae068610 with status ACTIVE [ 1450.205141] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.205831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.205916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.206168] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.206264] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.206461] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.206614] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.206654] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.206818] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.206915] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.207132] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.207236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.207294] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.207461] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.207583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.208035] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1412d053-4ac7-4ae0-b5b8-3a68ae068610 is going to be updated. [ 1450.230062] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.230367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.230367] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.230478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.230622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.230784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1412d053-4ac7-4ae0-b5b8-3a68ae068610" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.709672] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.212426] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.212676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.212676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.212858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.212953] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.213066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 is going to be created. [ 1451.236614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.236864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.236864] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.237061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.237232] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.246945] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: UNINITIALIZED for 2s [ 1453.258637] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: SUCCESS [ 1453.259058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.259058] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.259218] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.259423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.259538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.259608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.259760] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.259840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.259926] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.260067] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.762356] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.265324] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 540c2a3c-591a-456b-8cd1-d92b75a22442: rpc.has_security_group_logging(os_id): False [ 1454.284255] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.284477] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.284587] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.284909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.285066] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.285416] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.285570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.285677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.285907] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.286049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.286187] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 is going to be created. [ 1454.339558] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.339792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.339847] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.340164] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.340444] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.350396] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: IN_PROGRESS for 2s [ 1454.697227] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.697444] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1456.362655] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: SUCCESS [ 1456.363128] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.698145] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.698543] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.699087] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.699476] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.700128] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.700494] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.701476] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.701895] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.702271] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.702660] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.703571] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.703941] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.705094] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.705094] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.705779] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.706199] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.989021] env[69350]: INFO networking_nsxv3.common.synchronization [req-97998677-a0f5-4f7e-b309-1ba58157fdc0 req-0bcab207-1839-4db3-bb72-e11dd2a270ef tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1495.989563] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGHEST for action security_group_members [ 1495.989857] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.990213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.990213] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.990290] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.990423] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.990492] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.990551] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.990691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.990779] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.990875] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.493044] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.493254] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.493337] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.493550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.493662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.493861] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.493959] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.494035] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.494191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.494267] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.494352] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 is going to be updated. [ 1496.524250] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.524481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.524537] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.524769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.525009] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.533564] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: IN_PROGRESS for 2s [ 1498.544909] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 in Status: SUCCESS [ 1498.545317] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 deletion is rescheduled due to dependency. [ 1498.545317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.990717] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.991035] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.992073] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.992465] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.302567] env[69350]: INFO networking_nsxv3.common.synchronization [req-57383944-a9ab-43b5-a620-ac303006a6ed req-d4d09ad7-8fdc-40d6-987e-146d14868e20 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1507.302993] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGHEST for action security_group_members [ 1507.303362] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.303495] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.303553] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.303740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.303890] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.304336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.304415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.304776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.304776] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.304776] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.807077] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.807300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.807300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.807545] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.807653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.807854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.807957] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.808029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.808196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.808274] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.808362] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 is going to be updated. [ 1507.838317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.838569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.838569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.838738] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.838852] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.846901] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: IN_PROGRESS for 2s [ 1509.857654] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 in Status: SUCCESS [ 1509.857939] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 deletion is rescheduled due to dependency. [ 1509.857939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.985724] env[69350]: INFO networking_nsxv3.common.synchronization [None req-eefbdc2a-67f5-4fe9-8d39-6fa9d722f3e5 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1511.986280] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1511.986598] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.986709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.986774] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.987038] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.987127] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.052948] env[69350]: INFO networking_nsxv3.common.synchronization [None req-98ae0622-1df3-44fb-a5ca-45d580209eef tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1512.053451] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1512.053813] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.053921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.511060] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.511060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.511060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.511060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.511060] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.511423] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 already deleted. [ 1512.511423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.511497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.511765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.511915] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.034403] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.034784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.034784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.034893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.034932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.035066] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 already deleted. [ 1513.035157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.054531] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.054968] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.268854] env[69350]: INFO networking_nsxv3.common.synchronization [req-98f84643-1f92-48cd-ba89-813bd7d31d2d req-5455c8b8-d899-42b0-93f0-12adb63a90b5 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1517.268854] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1517.268854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.268854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.268854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.270190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.270190] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.270190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.270190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.270190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.270190] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.270190] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.528936] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.529207] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.529357] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.529640] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.529976] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.530151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.530240] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.530478] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.530657] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.530956] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1517.531099] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1517.531219] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1517.531335] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1517.531451] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1517.531563] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1517.531698] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1517.555696] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1517.555864] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1517.556012] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1517.556213] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.556533] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.556710] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.556834] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.557221] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.557370] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6045e256-25cf-44a5-b3b9-9ff5d11ca6c4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.772188] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.772415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.772415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.772596] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.772692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.772890] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.772990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.773067] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.773203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.773279] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.773363] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 already deleted. [ 1517.773435] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.060284] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.060795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.060795] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.060969] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.061102] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.061267] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 not found, creating... [ 1518.061538] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.061701] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.061828] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.062151] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.062283] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.062518] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.062680] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.062803] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.063031] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.063335] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.063335] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 is going to be created. [ 1518.084717] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.084982] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.085063] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.085361] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.085612] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.085864] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.757204] env[69350]: INFO networking_nsxv3.common.synchronization [req-98f84643-1f92-48cd-ba89-813bd7d31d2d req-4459d6f9-39fd-471b-ae86-278082edb177 service nova] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1518.757422] env[69350]: INFO networking_nsxv3.common.synchronization [req-98f84643-1f92-48cd-ba89-813bd7d31d2d req-4459d6f9-39fd-471b-ae86-278082edb177 service nova] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1518.757535] env[69350]: INFO networking_nsxv3.common.synchronization [req-98f84643-1f92-48cd-ba89-813bd7d31d2d req-4459d6f9-39fd-471b-ae86-278082edb177 service nova] Enqueued Resource ID: 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 with Priority: HIGHEST for action port [ 1518.757839] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_rules [ 1518.758062] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1518.758197] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 with Priority: HIGHEST for action port [ 1518.758745] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.758870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.758941] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.759550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.759644] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.760475] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.760594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.760995] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.761193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.761359] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.762238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.762311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.762575] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.762673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.762770] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.764111] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.764238] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.764308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.764488] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.764637] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6045e256-25cf-44a5-b3b9-9ff5d11ca6c4',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.265377] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.266377] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 with status ACTIVE [ 1519.266619] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.266745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.266813] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.266994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.267088] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.267270] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.267364] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.267420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.267574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.267707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.267893] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.267981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.268045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.268632] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.268741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.268837] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6045e256-25cf-44a5-b3b9-9ff5d11ca6c4 is going to be updated. [ 1519.270119] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.270201] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.292450] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.292749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.292749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.292893] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.293041] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.293302] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6045e256-25cf-44a5-b3b9-9ff5d11ca6c4" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.771656] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.274219] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.274586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.274586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.274861] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.275014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.275181] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 is going to be created. [ 1520.298954] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.299113] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.299187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.299397] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.299557] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.310581] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: UNINITIALIZED for 2s [ 1522.321051] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: SUCCESS [ 1522.321051] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.321427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.321427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.321617] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.321732] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.321817] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.321994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.322091] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.322176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.322264] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.825095] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.327417] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 775065a9-afb2-4468-8ed7-96c361d43874: rpc.has_security_group_logging(os_id): False [ 1523.345694] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.345863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.345937] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.346186] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.346277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.346526] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.346629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.346692] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.346850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.346916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.347009] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 is going to be created. [ 1523.403247] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.403511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.403511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.403751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.403827] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.413989] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: IN_PROGRESS for 2s [ 1523.759024] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.759236] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1525.427595] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: SUCCESS [ 1525.427595] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.760278] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.760700] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.761760] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.761760] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.762407] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.762804] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.763846] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.763846] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.764422] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.764997] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.216837] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1550.217260] env[69350]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ff1269bf-7e36-4f9e-8ccf-52c05f034f9d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1553.765353] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.765730] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.155918] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.156407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.156407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.156407] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.156580] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1556.658776] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.161299] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.663811] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1557.664027] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1558.374203] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.374608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.374608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.374608] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.524547] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1558.525414] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.526780] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1558.563946] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.564191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.564191] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.564384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.580597] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.581476] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1558.581550] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1558.581648] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1558.612962] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.613255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.613255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.613404] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.614185] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.614341] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1558.691524] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.691741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.691741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.691948] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.692257] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.692612] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1558.767237] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.767457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.767457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.767679] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.767988] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.768332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1558.768452] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'baf89025-1b14-46a4-b655-853662f51662', '540c2a3c-591a-456b-8cd1-d92b75a22442', '775065a9-afb2-4468-8ed7-96c361d43874', '081c1f78-eea5-4d74-9bbb-1632062d2cbc', 'e798eadb-b95f-4b24-8b57-576d46ec9704', '2156de29-689e-4010-ab8c-c4f9f41ec347', '61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6', 'e27c7362-80ef-4c99-9dd6-75361259db7f', '1cefdec3-6da8-484c-9ff1-2845e8cd40a7', '7c5d6740-3439-4769-8b56-9e97215cbf77', 'f9657ac2-98f3-4bb3-988b-9e7555afd46b', '0fd7257c-afd4-47d6-ae01-960d2d62dba1', 'e0d278d1-7f84-49c8-97b0-0922016d1fd0', '0ab8bb33-410e-45b2-83bb-f1219bc73c45', '8c926423-569b-4b98-81ac-723b20e82ff8', '518254d1-d440-4d15-b32d-8975c834377a', '3546ebe1-f03c-4c52-959d-58ac3a2927bc', 'e42630d9-6f58-45c4-a768-a81a12bdfa43', 'a07d8013-92b1-46a1-acb2-34b3df1ac235', 'f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f', 'f77ff482-c36b-41a0-9c84-caa4cc51cf3d', '8bcf01dc-147d-49bc-839a-137d73c85e2d', '250212f8-b7b8-4a59-919a-a1ed1d003c9a', '935f66d0-48ab-44a6-9d44-d9c84d53af88', 'ce5d9ba7-7740-404a-9bcb-b276b50dbc4b', 'b7d6c991-1741-482f-bd6f-0a1e7794c335'} {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1558.768567] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1558.769598] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.769703] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.790063] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.790342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.790342] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.790591] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.790689] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.790807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1558.790885] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1558.790957] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1558.880160] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.880467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.880467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.880642] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.881850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.882226] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1558.882363] env[69350]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69350) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1558.882467] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1558.882542] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1558.882642] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1558.882721] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGH for action security_group_rules [ 1558.882802] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGH for action security_group_rules [ 1558.882865] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGH for action security_group_rules [ 1558.882927] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGH for action security_group_rules [ 1558.882978] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGH for action security_group_rules [ 1558.883058] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGH for action security_group_rules [ 1558.883111] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGH for action security_group_rules [ 1558.883182] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGH for action security_group_rules [ 1558.883252] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGH for action security_group_rules [ 1558.883289] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGH for action security_group_rules [ 1558.883328] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGH for action security_group_rules [ 1558.883399] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGH for action security_group_rules [ 1558.883453] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGH for action security_group_rules [ 1558.883505] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGH for action security_group_rules [ 1558.883556] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGH for action security_group_rules [ 1558.883607] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGH for action security_group_rules [ 1558.883689] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGH for action security_group_rules [ 1558.883753] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGH for action security_group_rules [ 1558.883818] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGH for action security_group_rules [ 1558.883876] env[69350]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGH for action security_group_rules [ 1558.883970] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.770764] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.771162] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1563.771162] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf89025-1b14-46a4-b655-853662f51662 with Priority: HIGH for action security_group_rules [ 1563.771162] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGH for action security_group_rules [ 1563.771287] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGH for action security_group_rules [ 1563.771332] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c926423-569b-4b98-81ac-723b20e82ff8 with Priority: HIGH for action security_group_rules [ 1563.771437] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f with Priority: HIGH for action security_group_rules [ 1563.771520] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 with Priority: HIGH for action security_group_rules [ 1563.771608] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 with Priority: HIGH for action security_group_rules [ 1563.771698] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc with Priority: HIGH for action security_group_rules [ 1563.771785] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 with Priority: HIGH for action security_group_rules [ 1563.771871] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518254d1-d440-4d15-b32d-8975c834377a with Priority: HIGH for action security_group_rules [ 1563.771958] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 with Priority: HIGH for action security_group_rules [ 1563.772054] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 with Priority: HIGH for action security_group_rules [ 1563.772144] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b with Priority: HIGH for action security_group_rules [ 1563.772243] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 with Priority: HIGH for action security_group_rules [ 1563.772336] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 with Priority: HIGH for action security_group_rules [ 1563.772430] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 with Priority: HIGH for action security_group_rules [ 1563.772508] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27c7362-80ef-4c99-9dd6-75361259db7f with Priority: HIGH for action security_group_rules [ 1563.772572] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e798eadb-b95f-4b24-8b57-576d46ec9704 with Priority: HIGH for action security_group_rules [ 1563.772932] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 with Priority: HIGH for action security_group_rules [ 1563.773059] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc with Priority: HIGH for action security_group_rules [ 1563.773395] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baf89025-1b14-46a4-b655-853662f51662 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.773528] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.773826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.773826] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.774042] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baf89025-1b14-46a4-b655-853662f51662',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.774875] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.774990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.775062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.775242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.775319] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.776082] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.776211] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.776280] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.776445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.776524] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.777316] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c926423-569b-4b98-81ac-723b20e82ff8 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.777429] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.777496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.777647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.777722] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c926423-569b-4b98-81ac-723b20e82ff8',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.778437] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.778539] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.778604] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.778751] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.778817] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.779530] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a07d8013-92b1-46a1-acb2-34b3df1ac235 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.779639] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.779715] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.779849] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.779928] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a07d8013-92b1-46a1-acb2-34b3df1ac235',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.780591] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42630d9-6f58-45c4-a768-a81a12bdfa43 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.780694] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.780784] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.780909] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.780983] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42630d9-6f58-45c4-a768-a81a12bdfa43',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.781761] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.781869] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.781925] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.782093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.782178] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3546ebe1-f03c-4c52-959d-58ac3a2927bc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.782806] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.782914] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.782985] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.783140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.783210] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ab8bb33-410e-45b2-83bb-f1219bc73c45',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.783909] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518254d1-d440-4d15-b32d-8975c834377a taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.784016] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.784106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.784178] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.784249] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518254d1-d440-4d15-b32d-8975c834377a',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.784998] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.785200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.785200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.785319] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.785392] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d278d1-7f84-49c8-97b0-0922016d1fd0',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.786055] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.786182] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.786253] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.786408] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.786472] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7257c-afd4-47d6-ae01-960d2d62dba1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.787142] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.787273] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.787308] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.787469] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.787536] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9657ac2-98f3-4bb3-988b-9e7555afd46b',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.788305] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c5d6740-3439-4769-8b56-9e97215cbf77 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.788416] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.788550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.788629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.788702] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c5d6740-3439-4769-8b56-9e97215cbf77',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.789396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.789503] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.789568] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.789717] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.789790] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cefdec3-6da8-484c-9ff1-2845e8cd40a7',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.790456] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2156de29-689e-4010-ab8c-c4f9f41ec347 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.790558] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.790622] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.790854] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.790854] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2156de29-689e-4010-ab8c-c4f9f41ec347',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.791511] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27c7362-80ef-4c99-9dd6-75361259db7f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.791618] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.791680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.791830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.791902] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27c7362-80ef-4c99-9dd6-75361259db7f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.792718] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e798eadb-b95f-4b24-8b57-576d46ec9704 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.792788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.792919] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.793037] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.793112] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e798eadb-b95f-4b24-8b57-576d46ec9704',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.793763] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-540c2a3c-591a-456b-8cd1-d92b75a22442 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.793870] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.793936] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.794100] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.794171] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('540c2a3c-591a-456b-8cd1-d92b75a22442',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.794821] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.794928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.794993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.795155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.795228] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('081c1f78-eea5-4d74-9bbb-1632062d2cbc',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.302732] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.302928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.302928] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.303157] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.303320] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.303425] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.303489] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.303633] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.303713] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.303801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.303886] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.312800] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.312964] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.313074] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.313236] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.313390] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.313487] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.313548] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.313706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.313769] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.313850] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.313933] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.372788] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.373028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.373028] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.373196] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.374882] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.375073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.375768] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.375906] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.376614] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.376749] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.377422] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.377532] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.378574] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.378707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.379409] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.379507] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.380240] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.380325] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.381121] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.381121] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.381810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.381932] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.382582] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.382674] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.383281] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.383704] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.383797] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.384428] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.384810] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.384904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.385483] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.385885] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.385976] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.386581] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.386973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.387079] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.387684] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.388073] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.388200] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.388703] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.389125] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.389219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.390137] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.390519] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.390629] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.393133] env[69350]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1564.393523] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.393635] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9657ac2-98f3-4bb3-988b-9e7555afd46b is going to be deleted. [ 1564.394467] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.394672] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.414497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.414634] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 540c2a3c-591a-456b-8cd1-d92b75a22442 is going to be deleted. [ 1564.415496] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.415709] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.435675] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.435870] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e798eadb-b95f-4b24-8b57-576d46ec9704 is going to be deleted. [ 1564.436755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.436979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.454376] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.454590] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.456706] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.456859] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ab8bb33-410e-45b2-83bb-f1219bc73c45 is going to be deleted. [ 1564.457685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.457902] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.466396] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.466635] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.478206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.478359] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7257c-afd4-47d6-ae01-960d2d62dba1 is going to be deleted. [ 1564.479271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.479484] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.491793] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.491993] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.517102] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.517389] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c5d6740-3439-4769-8b56-9e97215cbf77 is going to be deleted. [ 1564.518282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.518511] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.520345] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.520481] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.591658] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.591836] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cefdec3-6da8-484c-9ff1-2845e8cd40a7 is going to be deleted. [ 1564.592733] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.592962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.619916] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.620146] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c926423-569b-4b98-81ac-723b20e82ff8 is going to be deleted. [ 1564.621355] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.621693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.648630] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.648844] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.649504] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.649599] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.670162] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.670332] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f is going to be deleted. [ 1564.671260] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.671486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.684590] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.684843] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.703722] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.703975] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.706353] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.706494] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3546ebe1-f03c-4c52-959d-58ac3a2927bc is going to be deleted. [ 1564.707409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.707626] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.780024] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.780400] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2156de29-689e-4010-ab8c-c4f9f41ec347 is going to be deleted. [ 1564.781127] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.781398] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.782766] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.782877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.808031] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.825465] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.832483] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.832660] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d278d1-7f84-49c8-97b0-0922016d1fd0 is going to be deleted. [ 1564.833913] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.834156] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.836381] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.836516] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.877418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.877592] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518254d1-d440-4d15-b32d-8975c834377a is going to be deleted. [ 1564.878504] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.878724] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.935685] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.935917] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baf89025-1b14-46a4-b655-853662f51662 is going to be deleted. [ 1564.936753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.936951] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.971653] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.971870] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a07d8013-92b1-46a1-acb2-34b3df1ac235 is going to be deleted. [ 1564.972740] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.972962] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.028087] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.028242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.028973] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.029083] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.030652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.030753] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.054399] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.054573] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27c7362-80ef-4c99-9dd6-75361259db7f is going to be deleted. [ 1565.055474] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.055693] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.081974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.082174] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42630d9-6f58-45c4-a768-a81a12bdfa43 is going to be deleted. [ 1565.083059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.083289] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.085317] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.085446] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.145045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.145232] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 081c1f78-eea5-4d74-9bbb-1632062d2cbc is going to be deleted. [ 1565.146265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.146505] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.146603] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.146729] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9657ac2-98f3-4bb3-988b-9e7555afd46b" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.146887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.147059] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.147144] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.147291] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-540c2a3c-591a-456b-8cd1-d92b75a22442" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.147790] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.148133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.148311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.148486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e798eadb-b95f-4b24-8b57-576d46ec9704" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.148567] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.148718] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.148795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.148904] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ab8bb33-410e-45b2-83bb-f1219bc73c45" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.149048] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.149199] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.149292] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.149409] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7257c-afd4-47d6-ae01-960d2d62dba1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.149538] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.149680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.149756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.149863] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c5d6740-3439-4769-8b56-9e97215cbf77" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.149990] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.150146] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.150225] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.150338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cefdec3-6da8-484c-9ff1-2845e8cd40a7" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.150465] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.150606] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.150680] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.150789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c926423-569b-4b98-81ac-723b20e82ff8" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.150918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.151072] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.151155] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.151293] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f8248d-46c4-46cd-8f64-a4e9dd1b8e1f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.151427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.151569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.151644] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.151755] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3546ebe1-f03c-4c52-959d-58ac3a2927bc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.151879] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.152029] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.152109] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.152217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d278d1-7f84-49c8-97b0-0922016d1fd0" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.152345] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.152486] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.152560] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.152673] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518254d1-d440-4d15-b32d-8975c834377a" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.152800] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.152938] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.153018] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.153135] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2156de29-689e-4010-ab8c-c4f9f41ec347" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.153263] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.153413] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.153508] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.153623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baf89025-1b14-46a4-b655-853662f51662" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.157725] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.157872] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.157921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.158107] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.158217] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.158338] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27c7362-80ef-4c99-9dd6-75361259db7f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.175016] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.175252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.175252] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.175485] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.175583] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.175702] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42630d9-6f58-45c4-a768-a81a12bdfa43" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.176854] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.176983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.177061] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.177230] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.177317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.177427] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a07d8013-92b1-46a1-acb2-34b3df1ac235" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.265064] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.265242] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.265318] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.265517] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.265616] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.265778] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-081c1f78-eea5-4d74-9bbb-1632062d2cbc" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.310331] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 775065a9-afb2-4468-8ed7-96c361d43874: rpc.has_security_group_logging(os_id): False [ 1565.328204] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.328424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.328424] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.328566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.329664] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6: rpc.has_security_group_logging(os_id): False [ 1565.369968] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.370345] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.370518] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.370647] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.370785] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.370877] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.370971] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 is going to be updated. [ 1565.376236] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.376457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.376457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.376657] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.411310] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.411555] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.411677] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.411741] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.411942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.412044] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.412166] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 is going to be updated. [ 1565.447016] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.447265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.447394] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.447735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.447984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.461312] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: IN_PROGRESS for 2s [ 1565.485552] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.485745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.485745] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.485979] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.486152] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.520407] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: IN_PROGRESS for 2s [ 1567.475866] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: SUCCESS [ 1567.476219] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.537622] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: SUCCESS [ 1567.537858] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.773781] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.774169] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.774763] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.775206] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.776328] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.776804] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.994813] env[69350]: INFO networking_nsxv3.common.synchronization [req-97bd2050-02ab-41b7-9b3e-918dc2f6c24c req-972ab47e-b888-4553-8897-ba4ab0481d98 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1581.995359] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775065a9-afb2-4468-8ed7-96c361d43874 with Priority: HIGHEST for action security_group_members [ 1581.995772] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-775065a9-afb2-4468-8ed7-96c361d43874 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.995772] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.995974] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.996104] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.996184] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.996282] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.996359] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.996569] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.996623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.996686] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775065a9-afb2-4468-8ed7-96c361d43874',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.500244] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.500454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.500454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.500691] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.500781] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.500982] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.501114] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.501171] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.501300] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.501381] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.501455] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 is going to be updated. [ 1582.527705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.527910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.527910] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.528123] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.528265] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.536604] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: IN_PROGRESS for 2s [ 1584.547538] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775065a9-afb2-4468-8ed7-96c361d43874 in Status: SUCCESS [ 1584.547942] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775065a9-afb2-4468-8ed7-96c361d43874 deletion is rescheduled due to dependency. [ 1584.547942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775065a9-afb2-4468-8ed7-96c361d43874" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.647728] env[69350]: INFO networking_nsxv3.common.synchronization [req-3f7ab070-90d6-4ebc-92d9-4b857a58f676 req-7b9cf42f-74a5-4331-89d8-0a9164397b80 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1586.648107] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 with Priority: HIGHEST for action security_group_members [ 1586.648983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.648983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.648983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.648983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.648983] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.648983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.648983] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.649385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.649385] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.649385] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.745521] env[69350]: INFO networking_nsxv3.common.synchronization [None req-41da28ac-bf0f-4a30-b94c-49386d8fd64c tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1586.746109] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1586.746448] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.746586] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.746656] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.746918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.747010] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.816335] env[69350]: INFO networking_nsxv3.common.synchronization [None req-1747065a-b956-4439-8495-4618e22cad04 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1586.816889] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1586.817166] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.817271] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.153156] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.153326] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.153400] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.153665] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.153708] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.153903] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.154010] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.154075] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.154222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.154298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.154383] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 is going to be updated. [ 1587.181067] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.181250] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.181298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.181594] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.181801] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.189894] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: IN_PROGRESS for 2s [ 1587.268321] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.268550] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.268619] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.268875] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.269046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.269128] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cb87460-ea62-402b-b242-d0d247980850 already deleted. [ 1587.269179] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.269298] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.269480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.269577] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.789464] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.789464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.789464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.789946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.789946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.789946] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cb87460-ea62-402b-b242-d0d247980850 already deleted. [ 1587.789946] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.200149] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 in Status: SUCCESS [ 1589.200563] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6 deletion is rescheduled due to dependency. [ 1589.200563] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61d3db1e-f6ab-47cf-90a3-d1bf4eaf9cb6" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.271336] env[69350]: INFO networking_nsxv3.common.synchronization [None req-3ee3b575-1bab-405e-a2b8-5a2858b967e3 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1591.271336] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1591.271336] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.271735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.271735] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.271855] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.271940] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.336577] env[69350]: INFO networking_nsxv3.common.synchronization [None req-7da75e14-ab16-46af-8f7d-e0951ca9c687 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1591.336962] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1591.337284] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.337403] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.794358] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.794525] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.794582] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.794803] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.794981] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.794981] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb already deleted. [ 1591.795093] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.795222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.795418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.795485] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.315380] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.315809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.315809] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.315887] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.315921] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.316029] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb already deleted. [ 1592.316097] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.499386] env[69350]: INFO networking_nsxv3.common.synchronization [req-83bce16d-97e7-4f67-bd04-aa357ca2e74d req-c70cb969-a311-42ed-82b7-61e49ee2364d tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1593.499938] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1593.500262] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.500384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.500452] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.500697] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.500855] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.500950] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.501036] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.501192] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.501276] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.501367] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.799629] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.799849] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.799986] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.800305] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.800578] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.800767] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.800905] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.801160] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.801315] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.801528] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1593.801645] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1593.801756] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1593.801866] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1593.801976] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1593.802094] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1593.802228] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1593.820256] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1593.820406] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1593.820551] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1593.820733] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-881" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.821096] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.821279] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.821404] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.821720] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.821866] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.003876] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.004140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.004140] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.004362] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.004454] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.004658] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.004758] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.004820] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.004955] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.005042] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.005130] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cb87460-ea62-402b-b242-d0d247980850 already deleted. [ 1594.005228] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.323876] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.324189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.324189] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.324498] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.324678] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.324846] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 not found, creating... [ 1594.325117] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.325280] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.325402] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.325652] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.325806] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.326103] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.326268] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.326395] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.326633] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.326776] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.326919] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 is going to be created. [ 1594.349505] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.349752] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.349893] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.350205] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.350436] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.350666] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.030708] env[69350]: INFO networking_nsxv3.common.synchronization [req-83bce16d-97e7-4f67-bd04-aa357ca2e74d req-2f0ef5d0-4e6a-4989-82ce-a82468b2241e service nova] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1595.030966] env[69350]: INFO networking_nsxv3.common.synchronization [req-83bce16d-97e7-4f67-bd04-aa357ca2e74d req-2f0ef5d0-4e6a-4989-82ce-a82468b2241e service nova] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1595.031029] env[69350]: INFO networking_nsxv3.common.synchronization [req-83bce16d-97e7-4f67-bd04-aa357ca2e74d req-2f0ef5d0-4e6a-4989-82ce-a82468b2241e service nova] Enqueued Resource ID: 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 with Priority: HIGHEST for action port [ 1595.031270] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_rules [ 1595.031402] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1595.031499] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 with Priority: HIGHEST for action port [ 1595.032085] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.032235] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.032288] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.032478] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.032561] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.033370] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.033493] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.033559] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.033726] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.033868] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.034019] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.034078] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.034206] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.034262] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.034466] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.036975] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.037106] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.037163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.037311] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.037388] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.539424] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.540523] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.540662] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.540816] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 with status ACTIVE [ 1595.541010] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.541117] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.541180] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.541393] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.541482] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.541652] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.541805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.541805] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.541963] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.542045] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.542225] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.542317] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.542377] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.542589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.542589] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.542719] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1 is going to be updated. [ 1595.562748] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.562942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.562942] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.563148] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.563286] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.563442] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68b4e0ac-dddf-4ec3-a2fb-55d04c629bd1" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.045093] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.547509] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.547777] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.547880] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.548212] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.548356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.548555] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cb87460-ea62-402b-b242-d0d247980850 is going to be created. [ 1596.572986] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.573187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.573187] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.573384] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.573542] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.588022] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: UNINITIALIZED for 2s [ 1596.610397] env[69350]: INFO networking_nsxv3.common.synchronization [req-f84a70cf-7dd6-455f-b0a7-21adbb7bc018 req-b61d8d3d-a035-4615-8a29-e1561ff1b9ac tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1596.610917] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1596.611239] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.611356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.611423] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.611676] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.611830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.611933] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.611997] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.612163] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.612246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.612335] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.873768] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.874017] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.874179] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.874495] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.874792] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.874986] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.875150] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.875415] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.875599] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.875843] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1596.875977] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] NeedRegenerationException {{(pid=69350) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1596.876127] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] no value, waiting for create lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1596.876245] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] value creation lock acquired {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1596.876382] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] No value present for key: 'zone-id' {{(pid=69350) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1596.876543] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Calling creation function for not-yet-present value {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1596.876711] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1596.895746] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1596.895974] env[69350]: DEBUG dogpile.cache.region [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69350) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1596.896125] env[69350]: DEBUG dogpile.lock [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Released creation lock {{(pid=69350) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1596.896324] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "network-390" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.896767] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f taken with stack trace [, , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.896972] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.897116] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.897456] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.897600] env[69350]: DEBUG networking_nsxv3.api.rpc [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f7fb89e-dffc-47cc-88a7-62c9a6016a2f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.114827] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.115234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.115234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.115234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.115361] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.115538] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.115643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.115707] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.115865] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.115944] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.116049] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb already deleted. [ 1597.116176] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.400098] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.400470] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.400682] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.401110] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.401414] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.401672] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Segment Port 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f not found, creating... [ 1597.402095] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.402349] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.402543] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.402877] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.403116] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.403550] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.403798] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.403988] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.404318] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.404535] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.404757] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Resource: SegmentPort with ID: 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f is going to be created. [ 1597.424991] env[69350]: DEBUG networking_nsxv3.common.locking [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.425244] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.425411] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.425764] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.426256] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.426584] env[69350]: DEBUG oslo_concurrency.lockutils [None req-79f9d53c-f83d-4fc7-8969-ba13813d6928 None None] Releasing lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.088157] env[69350]: INFO networking_nsxv3.common.synchronization [req-f84a70cf-7dd6-455f-b0a7-21adbb7bc018 req-2a0a182a-382b-46d5-83dc-f212750d8bda service nova] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1598.088357] env[69350]: INFO networking_nsxv3.common.synchronization [req-f84a70cf-7dd6-455f-b0a7-21adbb7bc018 req-2a0a182a-382b-46d5-83dc-f212750d8bda service nova] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1598.088509] env[69350]: INFO networking_nsxv3.common.synchronization [req-f84a70cf-7dd6-455f-b0a7-21adbb7bc018 req-2a0a182a-382b-46d5-83dc-f212750d8bda service nova] Enqueued Resource ID: 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f with Priority: HIGHEST for action port [ 1598.088810] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_rules [ 1598.088951] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1598.089068] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f with Priority: HIGHEST for action port [ 1598.089897] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.090086] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.090204] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.090445] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.090575] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.091529] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.091727] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.091830] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.092046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.092242] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.092382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.092480] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.092696] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.092836] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.092966] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.094086] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.094277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.094382] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.094574] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.094719] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f7fb89e-dffc-47cc-88a7-62c9a6016a2f',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.596184] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.597280] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.597420] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.597553] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f with status ACTIVE [ 1598.597705] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.597815] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.597881] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.598103] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.598203] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.598362] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.598457] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.598521] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.598712] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.598788] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.598963] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.599071] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.599133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.599275] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.599347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.599430] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f7fb89e-dffc-47cc-88a7-62c9a6016a2f is going to be updated. [ 1598.601097] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: SUCCESS [ 1598.601277] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.601623] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.601789] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.601936] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.602046] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.602111] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.602251] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.602328] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.602410] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.602497] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.621648] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.621823] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.621871] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.622049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.622193] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.622347] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f7fb89e-dffc-47cc-88a7-62c9a6016a2f" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.103016] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.104207] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.606830] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.607133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.607133] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.607295] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.607387] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.607490] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb is going to be created. [ 1599.608783] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cb87460-ea62-402b-b242-d0d247980850: rpc.has_security_group_logging(os_id): False [ 1599.625523] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.625728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.625728] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.625918] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.626013] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.626256] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.626356] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.626418] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.626566] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.626643] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.626730] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cb87460-ea62-402b-b242-d0d247980850 is going to be created. [ 1599.634222] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.634373] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.634415] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.634570] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.634721] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.642713] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: UNINITIALIZED for 2s [ 1599.688273] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.688502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.688502] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.688759] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.688939] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.701807] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: IN_PROGRESS for 2s [ 1601.654042] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: SUCCESS [ 1601.654339] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.654380] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.654578] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.654787] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.654924] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.654994] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.655165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.655246] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.655330] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.655419] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.713451] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: SUCCESS [ 1601.713700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.158742] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.663020] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df0eb7ae-85eb-4113-9ef6-1b033a8438bb: rpc.has_security_group_logging(os_id): False [ 1602.680590] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.680750] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.680795] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.681040] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.681136] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.681410] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.681522] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.681584] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.681761] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.681842] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.681934] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb is going to be created. [ 1602.740811] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.741034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.741034] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.741249] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.741436] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.751428] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: IN_PROGRESS for 2s [ 1603.090247] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.090445] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1604.764599] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: SUCCESS [ 1604.764984] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.091273] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.091718] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.092245] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.092555] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1618.092892] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.093312] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.094109] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.094490] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.095440] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.095845] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1633.097218] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1633.097602] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1638.098711] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1638.099166] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.100693] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1643.100693] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1648.101786] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1648.102330] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1653.103504] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1653.103880] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.091381] env[69350]: INFO networking_nsxv3.common.synchronization [req-e30bb69e-2edb-4db1-8118-a7b4df86e1d0 req-996b6198-418e-497b-b4d8-9647c81df801 tempest-AttachVolumeNegativeTest-365706305 tempest-AttachVolumeNegativeTest-365706305-project-member] Enqueued Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1656.092156] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb87460-ea62-402b-b242-d0d247980850 with Priority: HIGHEST for action security_group_members [ 1656.092272] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cb87460-ea62-402b-b242-d0d247980850 taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.092856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.092856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.092856] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.093081] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.093081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.093081] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.093255] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.093336] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.094013] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cb87460-ea62-402b-b242-d0d247980850',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.595653] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.595838] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.595898] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.596143] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.596240] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.596443] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.596544] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.596607] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.596757] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.596833] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.596920] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cb87460-ea62-402b-b242-d0d247980850 is going to be updated. [ 1656.631659] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.631840] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.631897] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.632073] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.632222] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.640775] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: IN_PROGRESS for 2s [ 1658.652144] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cb87460-ea62-402b-b242-d0d247980850 in Status: SUCCESS [ 1658.652497] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cb87460-ea62-402b-b242-d0d247980850 deletion is rescheduled due to dependency. [ 1658.652497] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cb87460-ea62-402b-b242-d0d247980850" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.092552] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.092806] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.093818] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.094211] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.095015] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.095015] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1672.797988] env[69350]: INFO networking_nsxv3.common.synchronization [req-78079da4-8c4b-4f71-9c5a-28857d3e1f1c req-af1a6c65-3f87-47c9-94ba-b9087d5d1430 tempest-AttachVolumeTestJSON-284175308 tempest-AttachVolumeTestJSON-284175308-project-member] Enqueued Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1672.798576] env[69350]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb with Priority: HIGHEST for action security_group_members [ 1672.798862] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb taken with stack trace [, , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.798991] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.799234] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.799440] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.799599] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.799700] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.799765] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.799920] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.800014] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.800109] env[69350]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0eb7ae-85eb-4113-9ef6-1b033a8438bb',) {} {{(pid=69350) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.302638] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.302834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.302834] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.303062] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.303165] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.303363] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.303464] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.303529] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.303681] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.303756] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.303845] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb is going to be updated. [ 1673.329610] env[69350]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69350) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.329792] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.329831] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.330049] env[69350]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.330198] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.338746] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: IN_PROGRESS for 2s [ 1675.350024] env[69350]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb in Status: SUCCESS [ 1675.350434] env[69350]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0eb7ae-85eb-4113-9ef6-1b033a8438bb deletion is rescheduled due to dependency. [ 1675.350434] env[69350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0eb7ae-85eb-4113-9ef6-1b033a8438bb" {{(pid=69350) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.800036] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1677.800036] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1682.801592] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1682.802026] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1687.803279] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1687.803279] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1692.804318] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1692.804791] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1697.805526] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1697.805981] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1702.807474] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1702.807474] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1707.808698] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1707.809146] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1712.810494] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1712.810834] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1717.812076] env[69350]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1717.812427] env[69350]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0